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It  is  common  in  educational  and  behavioral  studies  to 
encounter  situations  in  which  a  difference  in  means  is 
accompanied  by  a  difference  in  variances.  In  this  case,  the 
independent  samples  t-test  has  been  shown  to  work  poorly. 
Several  alternative  methods  have  been  suggested  in  the 
biometrics  literature. 

Three  hundred  and  sixty  simulated  experiments  were 
conducted  to  compare  Type  I  error  rates  and  power  of  the 
independent  samples  t-test,  Welch's  test,  and  the  four 
alternative  methods  from  the  biometrics  literature.  The 
factors  were  (a)  total  sample  size  (40,  80,  120),  (b)  sample 
size  ratio  (2/3,  1,  3/2),  (c)  the  ratio  of  standard  deviations 
for  the  experimental  and  control  groups  (1/3,  1/2,  1,  2,  3) 
(d)  power  of  the  tests  under  normality  and  homoscedasticity 
-5/     -7,     .9),    and    (e)    type    of    distribution  (normal, 

iv 


lognormal) . 

Results  of  the  study  show  that,  with  one  exception,  all 
of  the  methods  investigated  had  good  control  of  the  Type  I 
error  rates.  When  data  were  lognormal,  the  test  developed  by 
Brownie,  Boos,  and  Hughes -Oliver  did  not  control  the  Type  I 
error  rate.  The  alternative  methods  had  greater  power  than  the 
independent  samples  t-test  and  Welch's  test  when  the  standard 
deviation  ratio  was  larger  than  1.  Also,  the  alternative 
methods  showed  better  power  when  data  were  sampled  from  the 
normal  distribution  than  when  the  data  was  from  the  lognormal 
distribution.  Of  the  four  alternatives,  a  test  suggested  by 
Conover  and  Salsburg  had  the  best  power  and  appears  to  be  the 
most  promising  for  use  in  educational  research. 
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CHAPTER  1 
INTRODUCTION  AND  LITERATURE  REVIEW 

A  common  belief  among  educational  researchers,  in 
particular,  and  educators,  in  general,   is  that  the 
effectiveness  of  instructional  methods  depends  on  the  type 
of  students  with  whom  the  methods  are  used.  Consider  a 
situation  in  which  the  effectiveness  of  two  instructional 
methods  is  measured  by  a  criterion  variable  such  as 
achievement.  As  depicted  in  Figure  1,   the  relative 
effectiveness  of  the  two  methods  depends  on  the  pretest 
level  of  the  student,  where  the  pretest  variable  is  some 
predictor  of  the  criterion.  Each  line  in  Figure  1  represents 
the  regression  of  the  criterion  on  the  predictor  for  the 
students  exposed  to  one  of  the  two  instructional  methods .  In 
this  figure,   the  difference  in  the  effectiveness  is  larger 
for  the  students  who  are  high  on  the  predictor  than  it  is 
for  students  who  are  low  on  the  predictor. 

Consider  an  experiment  comparing  two  instructional 
methods  and  suppose  the  researcher  has  hypotheses  about  the 
specific  predictors  on  which  relative  effectiveness  depends. 
The  hypotheses  can  be  tested  by  collecting  data  on  the 
predictors  and,   for  each  predictor,   testing  equality  of  the 
slope  across  instructional  methods.  Now  suppose  the 
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Predictor  • 


Figure  1:  Treatment  comparison  in  which  treatment  effects 
depend  on  predictor  score. 


researcher  does  not  have  any  specific  hypothesis  or  cannot 
narrow  the  number  of  possible  predictors  to  a  manageable 
number.  How  can  the  researcher  proceed? 

One  procedure  is  to  analyze  the  criterion  data  using 
the  independent  samples  t-test.  However,   if  the  situation 
conforms,   for  example,   to  Figure  1  and  if  the  conditional 
variances  are  equal  in  the  two  groups,   the  marginal 
variances  will  be  unequal.  Therefore  the  equality  of 
variance  assumption  of  the  independent  samples  t-test  will 
be  violated.  In  Figure  1,  H<,:  /i^  -  /x^  =  0  is  false. 
Consequently,   the  researcher  need  not  be  concerned  about  the 
impact  of  the  violation  on  the  Type  I  error  rate.  Rather, 
the  researcher  should  be  concerned  about  whether  other 
procedures  are  more  powerful  than  the  independent  samples  t- 
test  when  a  difference  in  means  is  accompanied  by  a 
difference  in  variances . 

In  the  biometrics  literature   (Brownie,  Boos,   &  Hughes- 
Oliver,   1990;  Conover  &  Salsburg,   1988;  and  Good,  1979), 
several  procedures  have  been  proposed  for  situations  in 
which  an  experimental  treatment  is  compared  to  a  control  and 
the  mean  or  the  mean  and  variance  are  expected  to  increase 
under  the  experimental  treatment.  An  advantage  of  these 
procedures  is  that  they  have  better  power  than  the 
independent  samples  t-test  when  the  mean  and  variance 
increase  under  the  experimental  treatment   (Conover  & 
Salsburg,   1988;  and  Good,   1979) .  The  purpose  of  this 
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dissertation  is  therefore  to  compare  the  power  of  several 
procedures  in  situations  like  that  depicted  in  Figure  l.  The 
procedures  selected  for  comparison  are  the  independent 
samples  t-test  for  means,  Welch's  test,  and  several  of  the 
alternative  procedures  from  the  biometrics  literature. 

Review  of  Literature 

Assume  that  Y^,  Y^,    ...,Y„  are  independently  and 
identically  distributed  with  distribution  function  and 
^n+l  /    ^n+2  /     •  •  •  /  Yjj^„  are  independently  and  identically 
distributed  with  distribution  function  G^.  Good  (1979) 
investigated  the  case  in  which  not  all  experimental  subjects 
will  respond  to  treatment  and  was  interested  in  testing  Hq: 
G2(Y)   =  Gi(Y)   against  the  contaminated  alternative      :  G2(Y) 
=  pGi  (Y-A)  +  (l-p) Gi  (Y)  ,  where  p  is  the  proportion  of  subjects 
who  respond  to  the  experimental  treatment .  Let       be  the 
center  of  G^,   the  distribution  from  which  control  subjects 
are  sampled.  The  alternative  hypothesis  states  that  100(1- 
p)%  of  the  experimental  subjects  come  from    a  distribution 
identical  to  G^,   and  100p%  come  from  a  distribution  that  has 
center  /x^-A  but  otherwise  is  identical  to  G^ .  When  all 
subjects  are  capable  of  responding  (p=1.0),   the  uniformly 
most  powerful  test  under  normality  is  the  independent 
samples  t-test   (Best  &  Rayner,   1987)  .  A  mixture  of  non- 
responders  reduces  the  power  of  this  test  (Subrahmaniam, 
Subrahmaniam  &  Messeri,   1975) .  Hodges  and  Lehmann  (1956) 
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found  that  the  Wilcoxon  test  fares  even  worse.  The  reduction 
of  power  is  due  to  a  decrease  in  the  absolute  difference 
between  means  and  to  an  increase  in  the  variance  of  the 
treatment  sample.  As  Good  noted,   this  suggests  that  one 
consider  test  statistics  that  are  directly  proportional  to 
both  the  difference  in  sample  means  and  the  difference  in 
sample  variance. 

Good  (1979)   suggested  the  following  statistic: 

v(e)  -  e(^+^)-MF^-fj2+(i-e)55,  (d 

where       ,  SS^,  n^  (        ,  SS^,  n^)  denote  the  mean,   sum  of 
squared  deviations  about  the  mean,   and  size  of  the  control 
(treatment)     sample  and  O<0<1.  The  test  is  conducted  by- 
using  Fisher's  method  of  randomization  and  is  defined  as 
follows:  For  a  two  tailed  test,  reject  Ho  if  viO)  based  on 
the  original  observations  exceeds  a  proportion  a  of  all 
computed  values.  For  a  one  tailed  test,   reject  Hq  if  the 
treatment  mean  exceeds  the  control  mean  and  if  v{d)  based  on 
the  original  observations  exceeds  a  proportion  2a  of  all 
computed  values . 

The  value  that  must  be  selected  for  d  depends  on  p  and 
G^.  For  example,   if  p=i.O   (i.e.  all  treatment  subjects 
respond  to  treatment)   and  G^  is  normal,   selecting  0=1.0 
will  maximize  power.  Setting  6=1.0  yields  a  test  equivalent 
to  Fisher's  exact  test.  If  G^  is  normal  and  p<l.O,  setting 


6=p  tends  to  maximize  power  (Good,   1979) .  If  is 
lognormal,  power  tends  to  be  maximized  for  d<1.0  even  when 
p=1.0   (Good,   1979) .  Of  course  p  is  unknown  and  precise 
calibration  of  6  to  G^  is  unlikely.  As  a  result  Good 
suggested  using  0=0.67. 

Good  (1979)  conducted  a  small  simulation  and  showed 
that  when  G^  is  normal,  his  test  is  more  powerful  than  the 
independent  samples  t-test,  provided  p<l.O.  Good  included 
only  conditions  with  equal  sample  sizes   (4snsl2) .  According 
to  Good,   the  test  has  a  particular  advantage  when  the  sample 
size  is  small  and  A  is  large.  However,   inspection  of  Good's 
result  suggests  the  advantage  increases  from  n=4  to  n=12. 
Good's  simulation  also  showed  that  when  G^  is  lognormal,  his 
test  is  more  powerful  than  the  independent  samples  t-test 
(.2sp£l.O).  However,   it  also  has  a  slightly  elevated  Type  I 
error  rate  when  G^  is  lognormal.  Good's  conditions  with  G^ 
lognormal  were  limited  to  n^  =  nj  =  4 . 

The  randomization  procedure  used  in  Good's  procedure 
has  a  practical  limitation.  For  small  sample  sizes  the 
procedure  can  be  used  without  any  problems.  However,  for 
large  sample  sizes,   the  randomization  procedure  is 
computationally  intensive,   especially  in  simulation  studies. 
Thus  Good's  test  will  not  be  included  in  the  current  study. 

Contrary  to  Good's   (1979)   results,   a  study  by  Boos  and 
Brownie   (1986)   showed  that  the  Wilcoxon  test  was  quite 
useful  when  ps.6,   and  they  also  pointed  out  an  error  in 
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Good's   (1979)   definition  of  the  one-tailed  randomization 
test.  Boos  and  Brownie  noted  that  Good's  method  for 
performing  a  one-tailed  randomization  test  was  not  valid  in 
general.  Their  study  showed  that  for  p&.6,   the  Wilcoxon  test 
compares  favorably  with  the  independent  samples  t-test  and 
with  Good's  test. 

Mielke  and  Berry  (1994)  derived  a  permutation  procedure 
for  testing  differences  in  location  and  scale  among 
treatments  in  a  completely  randomized  design.  Consider  a 
completely  randomized  experiment    where  Q={oi^,  .... 
denotes  a  finite  sample  of  N  subjects  obtained  from  some 
super  population.  The  sample  is  partitioned  into  g  disjoint 
groups  Si,  ,  Sg.  Let 

be  the  distance  between  the  univariate  response  measurements 
of  subjects  oJi  and  Wj,  where  x^  denotes  a  response 
measurement  for      .   If  v=l,   then  A^  ^  is  the  Euclidean 
distance  between  response  measurements  and  the  following  is 
a  test  of  between-group  differences  in  location  and/or 
scale.  Let 
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represent  the  average  between- sub j ect  difference  for  all 
subjects  within  treatment  group        (k=l,..,g),  where  the 
summation  is  such  that  IsIsJsN  and  %(Uj)=l,   if    Wj  e  S^.  The 
average  within-group  difference  weighted  by  the  number  of 
subjects  n^  in  treatment  group        (k=l,..,g)   is  defined  by 

k-l 


where  ICk=l,   C^^=n^/L  and  h='Zn^  =  N. 

The  null  hypothesis  Hq  is  that  the  sample  values  are 
independent  of  group  membership.  The  probability  value 
associated  with  an  observed  value  of  6,   60,   is  the 
probability  under  Hq  of  observing    a  value  of  6  as  extreme 
or  more  extreme  than  60  •  An  exact  probability  value  is 
expressed  as 


p=P[6^6J  - 


number  of  6' s  (5) 


M 


where 


^--7  •  (6) 

k-i  " 
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To  compute  the  exact  probability  values,  Mielke  and  Berry- 
used  a  Pearson  Type  III  distribution  probability  value 
approximation.  Under  Hq,   the  mean,  variance  and  skewness  of 
6  are  given  by 

"  11) 


M 


(8) 


j-i 


and 


M 


j-i  


(9) 


respectively.  The  standardized  statistics  of  6  given  by 
T=  (S-jLtj) /ffj  is  approximated,  under  Hq,  by  the  Pearson  Type 
III  distribution  with  the  density  function  given  by 


4 

fiv)-  [-^^^^-^^xexp[-^^^-^>^ 

r(^)  Yft^ 
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where  -oo  <y<  -2/yj  and  7^  <0.     If  75  sO,  then  the  density 
function  of  the  Pearson  Type  III  distribution  is  given  by 


4 

2 


f(y)   [i^lZlAL]  ^  exp  ^.ZlSmhl^  (11) 

r(^)  Yfi' 


V  2 
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where     -2/75  <y<  00  -2/75   (Mielke,   1991).   If  75=0,   f  (y)   is  a 
standard  normal  distribution  given  by 

-4  v2  (12) 

f(y)-(27i)  2exp(-^). 


The  probability  value  for  an  observed  value  of  5, 60/  and, 
correspondingly,  To=  (Sq-Ms) /(^s/   is  given  by 


p=P[6^6J  =  I  fiy)dy. 


(13) 


Mielke  and  Berry  also  derived  a  multivariate  extension 
in  which  r  response  measurements  are  associated  with  subject 
(jj  ( 1=1 ,  .  .  .  ,  N)  .  The  distance  function  defined  in  (1)   is  now 
given  by 


■jj' 


(14) 
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When  u=l,   Aj  J  is  an  r- dimensional  Euclidean  distance  between 
the  response  measurements.  When  there  are  more  than  one 
response  measurements  for  each  object,   if  the  response 
measurement  are  expressed  in  different  units  they  must  be 
made  to  commensurate,  that  is,  standardization  among 
multivariate  responses  must  be  made.  For  example,  if 
y'i=(yii/  •  •  •  •  (Yri)  1=1/  .  .  .  ,N  denote  N  noncommensurate  r- 

dimensional  values,  the  corresponding  N  commensurate  r- 
dimensional  values  denoted  by  x'j=(Xij,  .  .  .  .,x^j)  are  given  by 
Xji=yii/0j  where 

KJ 


for  j=l,...,r.  The  commensurated  data  have  the  property  that 

Y,\xjj-xj^-l  (16) 

KJ 

for  j=l,...,r  and  any  choice  of  v.  This  commensuration 
procedure  is  called  Euclidean  commensuration  when  u=l  (Berry 
&  Mielke,   1992) .  An  alternative  commensuration  procedure 
called  Hotelling  commensuration  involves  the  distance 
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where  S  is  the  r  x  r  variance -covariance  matrix. 
The  procedure  for  computing  6,  M,  and  p  based  on  the  Pearson 
Type  III  distribution  for  the  multivariate  case  is  the  same 
as  the  univariate  case.  When  the  Hotelling  commensuration  is 
used,  with  gs2  and  v=2,   6  is  related  to  the  Bartlett-Nanda- 
Pillai  trace  statistic  for  multivariate  analysis  of  variance 
as  follows: 

6  =  ^1^.  „.  (18) 

■  N-g 

Mielke  and  Berry  (1994)   conducted  Monte  Carlo 
simulations  to  obtain  power  comparisons  for  multivariate 
permutations  tests.  The  power  comparisons  of  the  bivariate 
data  included  five  distributions:  bivariate  normal, 
bivariate  uniform,  bivariate  exponential,  bivariate 
lognormal,   and  bivariate  Cauchy.  The  comparisons  were  made 
at  Q?=0.01  and  a=0.05.  Each  comparison  involved  two  groups, 
where  the  first  was  the  control  group  and  the  second  was  the 
experimental  group  differing  from  the  control  group  by  a 
shift  in  location.  The  location  shift  for  the  normal, 
uniform,   exponential,   lognormal  and  Cauchy  were, 
respectively,   0.54,   0.20,   0.47,   0.73,   and  1.70.  The  sample 
sizes  considered  were  n^=ng=20.  The  three  permutation  tests 
consisted  of  (a)  Euclidean  commensuration,    (b)  Hotelling 
commensuration  with  v=l  and  Hotelling  commensuration  with 
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v=2.  Also  included  was  the  Bartlett-Nanda-Pillai  test.  Power 
results  showed  that  the  Euclidean  conimensuration  permutation 
test  performed  quite  well  for  the  five  distributions 
considered.  The  Hotelling  commensuration  with  v=2  and 
Bartlett-Nanda-Pillai  test  performed  very  well  for  both  the 
bivariate  normal  and  bivariate  uniform.  The  Euclidean 
commensuration  test  performed  better  than  the  other  tests 
for  the  bivariate  normal  at  a=0.01.  For  the  bivariate 
exponential,  bivariate  lognormal,  and  bivariate  Cauchy 
distributions,  the  Euclidean  commensuration  permutation  test 
and  Hotelling  commensuration  test  with  v=l  performed  better 
than  Hotelling  commensuration  test  based  on  v=2.  The 
Euclidean  commensuration  permutation  test  performed  better 
than  the  Hotelling  commensuration  test  with  u=l  for  all  five 
distributions.     The  actual  Type  I  error  rate  for  the 
Bartlett-Nanda-Pillai  test  were  substantially  lower  than  the 
nominal  Type  I  error  rate  for  the  bivariate  exponential, 
bivariate  lognormal,   and  bivariate  Cauchy  distributions. 

Johnson,  Verrill  and  Moore   (1987)   derived  a  locally 
most  powerful  rank  test  H^  against 

H^:   G2(Y)=pG3(Y)  +  (l-p)Gi(Y) 
where  G3  (Y) sGi  (Y)   for  all  Y.  Johnson  et  al .   studied  two 
special  cases  of  H2 .   In  the  first  case  G^  and  G3  are  normal 
cumulative  density  functions  with  common  a  and  G3(Y)=Gi(Y- 
A)  ,  so  H2  specializes  to  H^.  In  the  second  gi{Y)   and  gj  (Y)  , 
where  g^  and       are  densities  corresponding  to  G^  and  G3,  are 
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bi-uniform  densities.  For  each  the  range  of  Y  is   (a,d]  and 
the  step  in  the  density  occur  at  Y=c.  The  locally  most 
powerful  test  for  Hq  and  Hj  rejects  Hq  for  large  values  of 

n 
i-l 


-1 


(19) 


where  v'^'sV'^   ^Y(m+n)  j_g        ordered  sample  from  G^(x.)  and 

risrjfi  are  the  ranks  of  Y^,  .  .  .  .  .Y^  in  the  combined 

sample.   In  Equation  19,  g^  and       are  the  densities  of  (x) 
and  G3  (x)   respectively.  An  approximation  of  the  locally  most 
powerful  rank  test     is  given  by  replacing  the  expectation  in 
Equation  19  by  the  score 

rn+n+1 


where  J(u) ,   the  score  function,   is  defined  on  the  interval 
0<u<l  by  .    t  ■ 

^(u)-^3[gx-Mu)]_^    ■  (21) 


For  large  samples  sizes,  Johnson  et  al .  noted  that  there  was 
no  difference  between  the  locally    most  powerful  rank  test 
and  the  approximate  test . 

When  the  alternative  hypothesis  is  H^,   a  mixture  of 
normals   (MN) ,   the  score  function  is 


(22) 


-1 


where  $  is  the  standard  normal  cumulative  distribution 
function.  Note  that  to  use  the  score  function  A  must  be 
specified.  When       and       are  bi-uniform  (BU)  distributions 
the  score  function  is 


Jo,  0<u<,b^ 


(23) 


where 


.1 


ic-a) 
id-c) 


a<Y<,c 


c<Y^d 


(24) 


and 


9,iY)  = 


ic-a)  ' 
(d-c)  ' 


a<Y<.c 


c<Y^d 


(25) 


To  use  the  score  function  the  parameter  b^  in  the  density 
must  be  specified. 

By  using  the  asymptotic  relative  efficiencies  and 
simulation  results,  Johnson  et  al .  showed  the  following: 

1.  When        is  the  correct  score  function,   the  relative 
efficiency  of  the  Wilcoxon  or  normal  scores  test  is  <1.0. 
Similarly,  when  J^^  is  the  correct  score  function  the 


relative  efficiency  of  the  Wilcoxon  or  normal     scores  test 
is  <1 . 0 . 

2 .  When  Jgu  is  the  correct  score  function  the  relative 
efficiency  of  the  test  using  J„n  is  <1.0. 

3 .  When  J„n  is  the  correct  score  function  the  relative 
efficiency  of  J„n  using  a  misspecified  A  is  approximately 
0.8.  When  the  true  and  specified  A/c  are  different  by  0.5, 
when  the  true  difference  is  1.0,   relative  efficiency  is 
about  0.5. 

4.  When  J„jj  is  the  correct  score  function,  use  of  Jgu 
can  result  in  Type  I  error  rates  that  are  substantially  too 
high,  particularly  when  sample  sizes  are  small. 

5.  When  J„N  is  the  correct  score  function,  use  of 
Wilcoxon  or  normal  scores  test  results  in  a  loss  in  power 
that  increases  as  sample  sizes  increases  and  increases 
dramatically  as  A  increases. 

6.  When  J„n  is  the  correct  score  function.  Good's 
(1979)   test  has  power  comparable  to  the  test  using  J„f,- 

Conover  and  Salsburg  (1988)   noted  that  Good  (1979) 's 
alternative  hypothesis  is  a  special  case  of 

H^:  G^{Y)'pG^{Y)  +  {l-p)G^{Y)  ^^^^ 
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where  G3  (Y)  5^  G^(Y)  .  In  Good's  paper  G3{Y)=  Gi(Y-A).  Conover 
and  Salsburg  suggested  two  other  alternative  hypotheses 
based  on  the  Lehmann  alternative.  The  first  is 

H^:  G^iY)  -p[G^{Y)]'^  (l-p)  GJY) 


where  ral.  This  alternative    implies  that  measurement  of  a 
subject  who  responds  to  the  treatment  has  the  same 
distribution  as  the  maximum  of  r  responses  by  controls. 
Under  H3  the  range  of  scores  for  the  experimental  and 
control  subjects  is  the  same.  The  test  statistic  is  based  on 
the  locally  most  powerful  rank  test.  The  alternative 
hypothesis  H3  has  two  parameters  p  and  r.  Consideration  of 
each  parameter  by  itself  leads  to  two  different  cases,  each 
with  its  own  locally  most  powerful  rank  test.  To  test  the  Hg 
against  H3  as  p  approaches  0^,  the  locally  most  powerful 
rank  test  uses  the  statistic 

i-l 

where  Si{i)=   (N) ^^.i-i/ (N+t-1) N+i-i  are  the  scores  for  the 
locally  most  powerful  rank  test.   In  the  expression  for  s^, 

(N)k  =  N(N-l)  (N-k+1)  .  Conover  and  Salsburg  point  out 

that  an  alternative  to  s^  is 
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^  N+1 

Both  tests  have  the  same  asymptotic  relative  efficiency 
(ARE),  but  S2(i)   is  easier  to  use.  The  parameter  t  is 
unknown.  Conover  and  Salsburg  suggest  using  t=5  and  note 
that  7=2  yield  the  Wilcoxon  rank  sum  test   (Lehman,   1953) . 
Conover  and  Salsburg  point  out  that  use  of  Savage  scores 

j-i  J 

yields  the  locally  most  powerful  test  for  r.  They  report 
that  the  test  has  good  power  when  t=1,  but  not  when  3sts5 
which  they  argue  is  common  in  biometrics  data. 

Conover  and  Salsburg' s  second  alternative  hypothesis  is 


1-  [l-Gi(r)  ] 


+  (l-p)Gi(y) 


(31) 


which  implies  that  the  response  distribution  for  control 
subjects  is  the  same  as  the  distribution  of  the  minimum  of  r 
experimental  responses .  The  test  for  the  second  alternative 
hypothesis  is  similar  to  that  for  the  first  alternative, 
with  the  scores  for  the  locally  most  powerful  test  with  t 
approaching  1*,  given  by 
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1 


(32) 


1 


j-i 


N+l-i 


Scores  that  have  the  same  ARE  as  S3  but  are  easier  to 


calculate  are    given  by 


s^ii)  --ln[l 


1 


(33) 


N+1 


Conover  and  Salsburg  do  not  report  a  test  for  parameter  p  in 
the  second  alternative  hypothesis.  Critical  values  for  the 
methods  can  be  obtained  for  small  samples  by  tabulating  the 
randomization  distribution  of  T.  For  large  samples  Conover 
and  Salsburg  suggest  applying  the  independent  samples  t-test 
to  the  scores.  They  report  that  a  simulation  study  supports 
this  method  even  when  there  are  as  few  as  five  subjects  in 
each  group. 

Conover  and  Salsburg  (1988)   applied  the  methods , using 
Si,   S2,   S3  and  S4,  the  method  due  to  Johnson,  Verrill,  and 
Moore,  Good's  test,   and  the  independent  samples  t-test  to 
two  data  sets.  They  noted  that   (a)  use  of  s^  and  Sj  yields 
the  smallest  p  values  and  (b)   the  p  values  for  Si  and  S2, 
and  S3  and  S4  are  fairly  similar.  Recall  that  Sa  is  an 
approximation  to  s^  and  S4  is  an  approximation  to  S3. 

Brownie,  Boos  and  Hughes-Oliver  (1990)  proposed  a 
modification  of  the  independent  samples  t-test  and  F-test  to 
achieve  better  power  in  situations  where  increased 
variability  is  expected  to  be  a  consequence  of  treatment 


effect.  To  test  the  hypothesis 


20 
(34) 


the  proposed  modification  of  the  independent  samples  t-test 
is  given  by 


Y  -Y 
t„  ^  " 


(35) 


with  n^-1  degrees  of  freedom.  For  testing  equality  of  three 
or  more  means,   the  modified  F  is  given  by 


'£n,iY,_-Y__)Vik-l) 


F, 


1-1 


(36) 


m 


2 


with  k-1  and  n^-l  degrees  of  freedom. 

Brownie  et  al .  conducted  simulations  to  compare  the 
independent  samples  t-test  and  the  modified  t-test  for  given 
n^,  n^,  A^=  ([i^-ixj  /a^,  p  =  aj'/a^^  and  significance  level  a.  The 
power  curves  showed  that  for  fixed  n^,  n^,   and       the  power 
gain  for  the  modified  t-test  increases  as  p  increases.  The 
difference  in  power  of  the  two  procedures  also  depends  on 
the  sample  size.   If  p>l  then  for  fixed  A  and  n^sn^,  the 
power  advantage  of  the  modified  t-test  increases  as  the 
proportion  of  observation  in  the  treatment  group  increases. 

Brownie  et  al .    (1990)  warn  that  the  decision  to  use  the 
modified  procedure  should  be  made  a  priori,  and  not  because 


variability  appears  low  for  some  subset  of  the  groups.  Also, 
the  modified  t-test  and  F-test  should  not  be  used  when  the 
number  of  control  observations  is  small   (n^<10)  because  of 
the  power  calculations  and  because  of  a  general  stability  of 
the  variance  estimate. 

Blair  and  Sawilosky  (1993)   investigated  the  impact  of 
violating  the  normality  assumption  on  the  Type  I  error  rate 
and  power  of  the  modified  F-test, F„,   suggested  by  Brownie  et 
al.(1990).  They  included  four  distributions:  uniform,   t  with 
df=3,   exponential  and  chi-square  with  df=l.  The  number  of 
groups  varied  from  2  to  10  in  steps  of  2  and  sample  size  per 
cell  was  either  10,   12,   40  or  80.  For  the  F„  tests, 
estimated  actual  Type  I  error  rates  were  below  nominal 
levels  for  the  uniform  distribution  and  above  nominal  levels 
for  the  remaining  distributions.  The  discrepancy  between 
nominal  and  estimated  actual  Type  I  error  rates  increased  as 
the  number  of  groups    increased  and  declined  as  the  sample 
size  per  cell  increased.  For  two  groups  and  a=0.05,  the 
maximum  discrepancy  between  nominal  and  estimated  actual 
Type  I  error  rates  was  -.003,    .021,0.39,   and  .068  for  the 
uniform,  t(3),  exponential  and  chi-square  (1)  distributions. 
As  expected  from  theoretical  and  empirical  results,   the  F 
test  was  generally  quite  robust.  Power  results  showed  that 
F^  was  less  powerful  than  F  when  the  groups  differed  only  in 
mean,  with  the  power  disadvantage  increasing  as  the  number 
of  groups  increased.  The  F„  test  had  larger  power  when 


groups  differed  in  mean  and  variance,  with  the  power 
advantage  increasing  as  the  number  of  groups  increased. 
Blair  and  Sawilosky  concluded  that  the  robustness  of  the 
fixed-effect  ANOVA  to  departures  from  population  normality 
does  not  carry  over  to  the  modification  proposed  by  Brownie 
et  al . ,   contrary  to  the  conclusion  by  Brownie  et  al . 

Brownie  et  al .  also  pointed  out  that  the  Welch 
technique  is  designed  for 

Ho:    /X^=/Xe,    CT^'/ffe'     VS  H^:    /i^/M^,    0^^°^^  (37) 

and  not  for 

Hq:     Mc  =  Me/      (^c'  =  £^e'       VS    H^:     Mci^Me/      t^e'  =  Pt^c^  (38) 

The  Welch  test  measures  the  distance  between  the  control  and 
treatment  means  (Y^  -  Y^)   in  terros  of   {a^^/n^  +a^^/n^)'^.  If 
n^^n^,   the  power  of  Welch's  test  cannot  exceed  the  power  of 
the  independent  samples  t-test.  For  ne>n^  and  p>l,  the 
independent  samples  t-test  is  more  powerful  than  Welch's 
test.  Thus  for  n^sn^  and  p>l,  Welch's  test  is  less  powerful 
than  the  independent  samples  t-test  and  hence  less  powerful 
than  the  modified  t-test.  However,   if  n^<n^  and  p>l  Welch's 
test  is  more  powerful . 

Statement  of  the  Problem 

In  educational  and  psychological  experimentation, 
researchers  are  likely  to  be  confronted  with  situations  in 
which  differences  in  means  are  accompanied  by  differences  in 
variance.  In  this  situation,  tests  such  as  the  independent 


samples  t-test,  which  assumes    homogeneity  of  variance,  may- 
be less  powerful  than  techniques  designed  for  use  when 
differences  in  means  accompany  differences  in  variance. 
Several  such  procedures  have  been  developed  in  the 
biometrics  literature. 

The  procedures  developed  in  the  biometrics  literature 
fall  into  two  classes.  The  first,   including  the  techniques 
developed  by  Johnson  et  al .    (1987)  and  Conover  and  Salsburg 
(1988) ,   comprise  tests  that  are  the  most  powerful  for 
certain  alternative  hypotheses.  However,  all  the  alternative 
hypotheses  imply  that  differences  in  means  will  be 
accompanied  by  differences  in  variance.   If  the  data  do  not 
conform  to  the  appropriate  alternative  hypothesis,  power 
will  be  negatively  impacted.   It  is  therefore  of  interest  to 
study  the  power  of  these  tests  when  differences  in  means  are 
accompanied  by  differences  in  variance,  but  the  data  do  not 
conform  to  the  specific  hypotheses  for  which  these  test  were 
designed.  The  second  class  of  tests,   including  those 
developed  by  Good  (1979),  Brownie  et  al .    (1990),  and  Mielke 
and  Berry  (1994)   comprises  tests  that   (a)   are  designed  to  be 
more  powerful  than  the  independent  samples  t-test  when 
differences  in  means  are  accompanied  by  differences  in 
variances  but   (b)  do  not  specify  a  particular  distribution 
in  the  alternative  hypothesis.  These  tests  should  be  more 
powerful  than  the  independent  samples  t-test  in  a  situation 
like  that  depicted  in  Figure  1.  Little  is  known  about  the 


degree  to  which  these  test  are  more  powerful  because 
available  analytic  and  simulation  results  cover  such  a  small 
range  of  conditions. 

The  purpose  of  the  present  study  was  to  compare  Type  I 
error  rate  and  power  of  the  alternative  procedures  to  the 
independent        samples    t-test  when  differences  in  means  are 
accompanied  by  differences  in  variances,  by  means  of  a  Monte 
Carlo  simulation  technique.  The  procedures  investigated  are 
those  developed  by  Johnson  et  al .    (1987),  Conover  and 
Salsburg  (1988),  and  Brownie  et  al.(1990).  The  procedure 
developed  by  Good  (1979)  and  Mielke  and  Berry  (1994)  are  not 
included  because  the  permutations  required  for  these  tests 
make  them  expensive  to  investigate  by  simulation  methods. 
The  performance  of  these  procedures  were  compared  with  the 
independent  samples  t-test  and  Welch's  test.  The  procedures 
were  investigated  for  both  equal  and  unequal  sample  sizes. 

Significance  of  the  Study 

A  variety  of  procedures  for  comparing  means  when 
variance  differences  are  expected  have  been  presented  in  the 
literature.  However,   these  procedures  have  not  been  compared 
with  one  another,   so  it  is  difficult  to  choose  among  the 
procedures.  This  study  will  provide  results  that  should 
prove  useful  in  making  a  choice  between  the  independent 
samples  t-test  and  one  or  more  of  the  alternative 
procedures,  and  thereby  enhancing  the  probability  of 


accurate  and  valid  conclusions  in  educational 
experimentation , 


CHAPTER  2 
METHODOLOGY 


In  this  chapter,   the  design  of  the  study  and  the 
simulation  procedures  employed  to  carry  out  the  study  are 
described.  The  factors  investigated  in  the  study  included 
total  sample  size,     sample  size  ratio,  mean  differences, 
standard  deviation  ratio,  and  type  of  distribution.  A  Monte 
Carlo  simulation  technique  was  used  to  investigate  the 
effect  of  the  factors  on  the  Type  I  error  rate  and  power  of 
the  alternative  procedures.  The  alternative  procedures 
investigated  were  Conover  and  Salsburg's  tests,  Johnson, 
Verrill  and  Moore's  test  for  mixed  normal  distributions,  and 
Brownie,  Boos  and  Hughes-Oliver's  modified  t-test.  For  the 
Johnson  et  al .  test  A/cr  was  set  to  0.6.  These  procedures  are 
designed  to  test  hypotheses  about  differences  between  means 
of  two  populations  when    differences  in  means  are 
accompanied  by  differences  in  variances.  In  addition,  the 
independent  samples  t-test  and  Welch's  test  were  also 
included  for  comparison  with  the  alternative  procedures. 

Design  of  Study 
The  probabilities  of  Type  I  error  and  power  were 
investigated  in  connection  with  the  factors  listed  in  the 
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preceding  paragraph.  The  levels  of  these  factors  are 
presented  in  the  following  paragraphs. 

Total  sample  size.  Three  total  sample  sizes  were 
included  in  the  study:  N=40,  N=80,  N=120.  These  sample  sizes 
span  the  range  from  small  to  fairly  large  studies. 

Type  of  distribution.  Two  types  of  distributions  were 
included  in  the  study:  the  normal  and  the  lognomal 
distributions.  The  choice  of  distributions  leads  us  to  a 
question  of  whether  the  data  in  the  study  is  representative 
of  what  is  found  in  practice,  especially  the  lognormal 
distribution.  Miceri   (1989)   conducted  a  study  of  skewness  of 
440  univariate  distributions  including  231  distributions  of 
standardized  achievement    and  ability  test  scores,  35 
distributions  of  criterion-ref enced  and  mastery  test 
scores,   125  distributions  of  personality  test  scores,  and  49 
distributions  of  gain  scores  based  on  the  preceding  types  of 
test  scores.  Miceri  used  skewness  and  two  other  criteria  to 
classify  distributions  with  respect  to  asymmetry.  The  cutoff 
scores  on  skewness  were  .32,    .71  and  2.00.  Of  the  440 
distributions  30.9%  were  classified  at  above  .71.  Of  all  the 
distributions  11.4%  were  classified  at  the  category  defined 
by  2.00  cut  score.   In  this  study,  data  generated  from  the 
lognormal  distribution  were  adjusted  so  that  skewness  was 
1.75.  Thus,   the  data  in  the  study  are  typical  of  what  is 
seen  in  the  literature. 
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Sample  size  ratio.  In  addition  to  conditions  with  equal 
sample  sizes   [(n3,nj   =   (20,20);    (40,40);  and  (60,60)], 
conditions  with  unequal  sample  sizes  were  employed  [(ne,nc) 
=    (24,16);    (16,24);    (48,32);    (32,48);    (72,48);   and  (48,72)]. 
Thus  the  sample  size  ratio  was  either  2/3,   1.0  or  1.5. 
Although  many  simulations  employ  a  wider  range  of  sample 
size  ratios,   a  sample  size  ratio  of  1.5     is  fairly  large  in 
randomized  experiments. 

Mean  difference.  Four  mean  differences  were  employed  in 
the  study.  One  mean  difference  was  zero.  This  permits 
estimation  of  Type  I  error  rates,   and  power  of  the 
alternative  procedure  to  detect  variance  differences.  The 
other  three  mean  differences  were  selected  so  that,  when  the 
variances  were  equal  and  a=0.05,   the  independent  samples  t- 
test  would  have  power  of  0.50,   0.70,   or  0.90.  These  power 
levels  were  selected  to  cover  a  range  of  power  from  moderate 
to  high.  The  effect  sizes  that  result  in  these  levels  of 
power  are  shown  in  Table  1  for  all  sample  size  combinations . 
In  Table  1,  we  assume  that  the  mean  for  the  control  group  is 
0  and  the  common  standard  deviation  is  1. 

Standard  deviation  ratio.  Five  levels  of  standard 
deviation  ratio  a^/^c  were  employed  :  3,   2,   1,   0.5  and  1/3. 
The  ratios  greater  than  1  are  conditions  under  which  the 
alternative  tests  are  expected  to  be  more  powerful  than  the 
independent  samples  t-test.  The  ratios  less  than  1  are 
included  to  investigate  how  well  the  alternative  procedures 


Table  1 

Effect  sizes  (q!=Q.05) 


Group  sizes  Power 


n. 

.50 

.70 

.  90 

20 

20 

.53 

.69 

.  94 

24 

16* 

.54 

.  71 

.96 

40 

40 

.37 

.49 

.66 

48 

32* 

.38 

.50 

.67 

60 

60 

.30 

.40 

.54 

72 

48* 

.31 

.41 

.55 

*  Interchanging  n^  and  n^  yields  the  same  power  when 
variances  are  homogeneous. 


30 

work  in  conditions  other  than  those  for  which  they  were 
designed.  When  oja^  =  3  or  2,   a^=l.  When  a^/o^  =  1/2  or  1/3, 

The  choice  of  the  standard  deviation  ratio  is  not 
unrepresentative  of  what  occurs  in  practice.  In  his  comments 
on  choosing  a  statistics  in  multivariate  analysis  of 
variance,   Stevens   (1979)   investigated  subgroup  variance 
differences  of  several  real  life  data  from  major  journals  in 
educational  and  psychological  research.  He  observed  that 
even  though  subgroup  variance  differences  as  high  as  36 
times  were  rare,   subgroup  variance  differences  as  high  as  9 
times  were  common.  Also,  Wilcox  (1987)  observed  that  among 
14  studies  found  in  the  American  Educational  Research 
Journal,   3  reported  sample  variance  ratios  greater  than  16. 
Wilcox  argued  that  equal  variances  should  not  be  taken  for 
granted,  when  conducting  educational  research.  Thus,  Stevens 
(1979)   and  Wilcox  (1987)     results  show  that  the  choice  of 
standard  deviation  ratio  in  this  study  is  within  the  range 
of  what  is  commonly  found  in  practice. 


Simulation  Procedures 
Random  Number  Generation  Procedure 

The  simulation  in  this  study  was  carried  out  using  the 
random  number  generating  functions  in  the  Statistical 
Analysis  System  (1985) .  These  random  number  generators  are 
described  below. 
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Normal  Distribution.  The  normal  random  deviates  were 
generated  by  employing  the  RANNOR  generator  in  SAS-IML. 

Loanormal  Distribution.  To  generate  the  lognormal 
scores  the  generator  RANNOR  was  used  to  generate  the  normal 
deviates   (Z)   and  the  lognormal  scores  were  then  obtained 
from  the  normal  through  transformation  Y=exp(Z).   In  general, 
if  Z  is  N(jU,a)   then  Y  is  lognormal  with  mean 
/Xln  -  exp{/x  +  aV2) 

and  variance 

a^/  =  [exp(2^  +  a^)  ]  [exp(a^) -1] 
(Mood,  Graybill  &  Boes,   1974) .   In  order  to  obtain  an 
acceptable  skewness,   the  transformation  from  normal  to 
lognormal  was  adjusted  so  that  the  skewness  for  the 
lognormal  distribution  was  1.75.  Setting  /x=0  and  a=0.5, 
gives  the  required  skewness. 

Data  Generation 

The  data  were  generated  by  using  the  following  steps 
for  each  condition: 

1.  Generate  n^  observations  from  the  target  population. 

2.  Generate  n^  observations  from  the  target  population. 

3.  For  the  lognormal  distributions,   standardize  the 
distributions  using  the  population  expected  value  and 
standard  deviation. 

4.  Multiply  each  of  the  observations  generated  in  step 
2  by    the  appropriate  constant  to  simulate 
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heteroscedasticity . 

5 .  For  non-null  conditions  add  the  appropriate  constant 
to  each  observation  in  the  experimental  group. 

For  each  replication,  the  data  were  analyzed  by  using 
the  independent  samples  t-test,  Welch's  t-test  and  the 
alternative  tests  listed  in  the  first  paragraph  of  this 
chapter. 

Summary 

A  total  of  360  experimental  conditions  were  simulated, 
with  5000  replications  for  each  condition.  These  conditions 
can  be  classified  into  three  groups: 

1.  There  were    18  conditions  with  p.^-fx^=Q  and  a^-a^. 
These  conditions  were  used  to  determine  the  Type  I  error 
rates . 

2.  There  were  72  conditions  with  fi^-fi^=0  and  a a ^. These 
conditions  were  used  to  determine    the  power  for  detecting 
variance  differences  only. 

3.  There  were  270  conditions  for  the  conditions  with 
/Xe-/Xc>0,   0^=0^  and  /Xe-jUc>0,   c^t^o^.  These     conditions  were  used 
to  determine  the  power  to  detect  differences  when  means 
differ.  .    •  i 


CHAPTER  3 
RESULTS  AND  DISCUSSION 


In  this  chapter  analyses  of  Type  I  error  rates  and 
power  are  presented  for  tests  conducted  at  a!=0.05.  The  data 
used  in  these  analyses  are  reported  in  Appendix  A.  Results 
in  this  chapter  are  reported  in  three  sections:  (a) 
estimated  Type  I  error  rates,    (b)   estimated  power  for 
variance  differences  only,  and  (c)  estimated  power  for  mean 
and  variance  differences.  For  each  section,  a  summary  of  the 
estimated  Type  I  error  rates  or  power  is  presented.  Then  a 
summary  of  the  analysis  of  variance   (ANOVA)  used  to 
investigate  the  effects  of  the  within- subjects  factor  and 
between- subjects  factors    on  the  Type  I  error  rates  or  power 
is  presented.  For  the  Type  I  error  rates  analyses,  the 
between- subjects  factors  were  total  sample  size  (N) ,  sample 
size  ratio  (n^/n^) ,   and  distribution  (D) ;  and  the  within- 
subject  factor  was  method  (M) .  For  the  power  analyses,  two 
additional  between- sub j ect  factors,   standard  deviation  ratio 
ia^/a^)   and  target  power  (P)  ,  were  included. 

Because  many  of  the  factors  that  affect  Type  I  error 
rates  and  power  were  included  in  the  study,   each  ANOVA 
yielded  a  large  number  of  significant  effects.  To  determine 
which  of  the  effects  to  interpret,  variance  components  were 
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computed  for  all  the  effects.  A  mean  square  component,  6^, 
for  each  effect  was  computed  using  the  formula  [ (MSF- 
MSE) /NT]    (Myers, 1979) ,  where  MSF  was  the  mean  square  error 
for  the  given  effect,  MSB  was  the  between- subjects  mean- 
square  error  when  the  given  effect  was  between- subjects 
effects  and  within- subjects  mean  square  error  when  the  given 
effect  was  the  within- sub j ect  effect  or  the  interaction  of 
the  within- subject  factor  and  between- subject  f actor (s),  and 
NT  was  the  number  of  levels  for  the  factors  not  included  in 
the  given  effect.  Negative  mean  square  error  components  were 
set  to  zero.  For  each  effect  with  a  non-negative  mean  square 
component,  the  proportion  of  variance  component  was  computed 
using  the  formula        (SMSF+MSEB+MSEW)  ,  where  SMSF  is  the  sum 
of  the  mean  square  errors  of  all  the  effects,  MSEB  is  the 
between- subject  mean  square  error  and  MSEW  is  the  wi thin- 
subjects  mean  square  error.  The  variance  components  values 
were  used  to  select  significant  effects  for  interpretation. 
An  effect  was  considered  important  if   (a)   it  was  significant 
and  (b)   the  variance  component  was  large  relative  to  the 
variance  component  associated  with  other  significant 
effects.  To  compromise  between  interpreting  a  large  number 
of  unimportant  effects  and  failing  to  interpret  an  important 
effect,  the  criterion  used  to  select  effects  for 
interpretation  was  the  proportion  of  variance  component 
greater  than  1%.  Other  researchers  have  used  this  criterion 
(Coombs,   1992;  and  Chirembo,   1995)  . 


35 

Estimated  Type  I  Error  Rates 
Table  2  shows  a  summary  of  the  distribution  of  the 
estimated  Type  I  error  rates  for  the  six  methods 
investigated  in  the  study.  By  Bradley's  liberal (1978) 
criterion,   a  test  is  robust  if   .Sa  sTsl.Sa,  where  o!  is  the 
nominal  level  of  significance  and  r  is  the  true  probability 
of  Type  I  error  rate.  Otherwise,  the  test  is  either 
conservative  or  liberal.  Using  Bradley's  liberal  (1978) 
criterion,   only  the  BT  method  is  liberal  in  any  conditions. 
However,   the  JT  method  appears  to  have  slightly  elevated 
Type  I  error  rates.  The  TT  and  WT  methods,   and  the  two 
methods  suggested  by  Conover  and  Salsburg  (1988) ,   CTl  and 
CT2,  have  estimated  Type  I  error  rates  closest  to  the 
nominal  level  of  significance.  Tables  3  and  4  show  a  summary 
of  the  distributions  of  the  estimated  Type  I  error  rates  for 
the  six  methods  when  data  were  generated  from  the  normal  and 
lognormal  distributions,  respectively.  Results  in  these 
tables  indicate  that  when  data  are  generated  from  the 
lognormal  distribution,   the  BT  method  tends  to  have  inflated 
Type  I  error  rates,  while  the  other  methods  maintain  control 
of  the  Type  I  error  rates .  When  data  are  generated  from  the 
normal  distribution,   all  the  methods  appear  to  maintain 
control  of  the  Type  I  error  rates,  by  Bradley's  criterion. 
However,  when  data  are  generated  from  either  the  normal  and 
lognormal  distributions.   Type  I  error  rates  for  the  JT 
method  are  slightly  elevated.  Thus,  when  data  are  lognormal. 
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Table  2 

Distributions  of  Estimated  Type  I  Error  Rates  for  the  Six 
Methods  (q!=0.05) 


Percentile 


Method 

MIN 

10 

25 

50 

75 

90 

MAX 

TT 

.045 

.045 

.046 

.  050 

.052 

.056 

.056 

WT 

.040 

.043 

.046 

.049 

.  052 

.058 

.  060 

BT 

.047 

.047 

.  051 

.061 

.078 

.096 

.097 

CTl 

.  045 

.045 

.047 

.051 

.052 

.054 

.  054 

CT2 

.  045 

.046 

.  048 

.049 

.  051 

.055 

.056 

JT 

.  047 

.048 

.  050 

.053 

.  055 

.060 

.061 

Note.  TT  =  independent  samples  t-test;  WT  =  Welch  test;BT  = 
Brownie  et  al . ' s  modified  t-test;  CTl  =  Conover  and 
Salsburg's  S2  test;  CT2  =  Conover  and  Salsburg's  S4  test;  JT 
=  Johnson  et  al . ' s  mixed  normal  test . 
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Table  3 

Distributions  of  Estimated  Type  I  Error  Rates  for  the  Six 
Methods:  Normal  Distribution  (q;=0.05) 


Percentile 


Method 

MIN 

10 

25 

50 

75 

90 

MAX 

TT 

.046 

.046 

.048 

.050 

.051 

.053 

.053 

WT 

.  046 

.046 

.048 

.050 

.  051 

.053 

.053 

BT 

.  047 

.  047 

.  047 

.051 

.052 

.054 

.054 

CTl 

.  045 

.  045 

.  047 

.051 

.051 

.054 

.054 

CT2 

.047 

.047 

.  049 

.  050 

.  051 

.056 

.056 

JT 

.049 

.049 

.052 

.053 

.  054 

.061 

.061 
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Table  4 

Distributions  of  Estimated  Type  I  Error  Rates  for  the  Six 
Methods:  Loqnormal  Distribution  (q!=0.05) 


Percentile 


Method 

MIN 

10 

25 

50 

75 

90 

MAX 

TT 

.  045 

.045 

.046 

.050 

.052 

.056 

.  056 

WT 

.040 

.040 

.  045 

.046 

.055 

.060 

.060 

BT 

.068 

.068 

.076 

.078 

.087 

.097 

.097 

CTl 

.045 

.045 

.  047 

.049 

.052 

.053 

.  054 

CT2 

.045 

.045 

.046 

.  049 

.051 

.055 

.  055 

JT 

.047 

.047 

.050 

.  051 

.057 

.060 

.060 

the  BT  method  is  not  recoiranended . 

Analysis  of  variance  (ANOVA)  was  used  to  investigate 
the  effects  on  the  Type  I  error  rates  of  the  following 
factors:  total  sample  size  (N) ,  sample  size  ratio  {n^/nj  , 
distribution  (D) ,   and  method  (M) .  All  the  factors  were 
between- sub j ect  factors  except  for  M,  which  was  a  within- 
subject  factor.  Because  there  were  many  significant  main  and 
interaction  effects,  only  the  significant  effects  that 
contributed  to  more  than  1%  of  the  total  variance 
were  considered  for  interpretation.  These  effects  are 
presented  in  Table  5 .  The  results  for  Type  I  error  rates  for 
tests  conducted  at  q;=0.01  and  a=0.10  are  similar  to  those 
reported  in  Table  5.  Variance  components  for  these  tests  are 
reported  in  Appendix  B . 

The  M.  D  and  MxD  effects.  Shown  in  Table  6  are  mean 
values  of  the  Type  I  error  rates  for  the  MxD  interaction. 
Results  in  this  table  indicate  that  when  data  are  generated 
from  the  lognormal  distribution,   the  Type  I  error  rate  for 
the  BT  method  is  substantially  larger  than  for  the  other 
methods.  The  other  tests  have  Type  I  error  rates  near  oi. 
When  data  are  generated  from  the  normal  distribution,  all 
the  methods  have  similar  Type  I  error  rates  and  maintain 
control  of  the  Type  I  error  rates.  Similar  observations  were 
made  earlier  from  the  summary  of  the  distributions  of  the 
Type  I  error  rates  for  the  normal  and  lognormal 
distributions.  A  theoretical  explanation  for  the  behavior  of 


Table  5 


Percent  of  Total  Variance  for 
Estimated  Type  I  Error 
Rates  Effects  Accounting  al%  of 
the  Variance  (q!=0.05) 


Effect  Percentage 


MxN 

2  .46 

Mxne/n^xD 

3  .85 

MxNxD 

4  .41 

Mxn^/n^ 

5.66 

D 

5.68 

M 

22  .46 

MxD 

47  .38 
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Table  6 

Mean  Estimated  Type  I  Error  Rates  as  a 
Function  of  Method  and  Distribution  (a!=0.05) 


Distribution 


Method 

N 

L 

TT 

.050 

.050 

WT 

.050 

.050 

BT 

.050 

.081 

CTl 

.050 

.050 

CT2 

.050 

.052 

JT 

.053 

.  053 
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BT,  when  data  is  lognormal,   is  given  in  Chapter  4.  In  Table 
7,  the  marginal  mean  values  of  the  estimated  Type  I  error 
rates  for  the  six  methods  are  presented.  Results  in  this 
table  show  that  the  BT  method  has  higher  Type  I  error  rates 
than  the  other  methods .  This  is  due  to  the  distribution 
effect  on  the  BT  method,  as  shown  in  Table  6.  The  other 
methods  appear  to  maintain  control  of  the  Type  I  error 
rates.  Again,   similar  conclusions  were  made  from  the  summary 
of  the  distribution  of  the  Type  I  error  rates.  Table  8  shows 
the  marginal  means  of  the  Type  I  error  rates  for  the  normal 
and  lognormal  distributions.  When  data  are  generated  from 
the  lognormal  distribution  the  Type  I  error  rates  are 
slightly  inflated;  with  data  generated  from  the  normal 
distribution  Type  I  error  rates  very  close  to  the  nominal 
level  of  significance.  The  inflated  results  of  the  lognormal 
distribution  are  due  to  the  effect  of  the  BT  method. 

The  MxN  and  MxNxD  effects .  In  Table  9,  the  mean 
estimated  Type  I  error  rates  for  the  MxNxD    interaction  are 
reported.  As  in  previous  tables,   the  results  indicate  that 
when  data  are  lognormal,  the  Type  I  error  rates  for  the  BT 
method  are  elevated.  The  Type  I  error  rate  for  BT  declines 
with  increasing  N.  For  all  the  methods,  when  data  are 
generated  from  the  normal  distribution,   the  total  sample 
size  does  not  appear  to  have  an  effect  on  the  Type  I  error 
rates.  In  Table  10,  mean  values  of  the  Type  I  error  rates 
are  presented  for  the  MxN  interaction.  The  table  shows  that 


Table  7 


as  a  Function  of  Methods 

(a=0.05) 

Method 

Means 

TT 

.050 

WT 

.049 

BT 

.066 

CTl 

.050 

CT2 

.  050 

JT 

.053 

Table  8 

Mean  Estimated  Type  I  Error  Rates 
as  a  Function  of  Distribution 
(q!=0  .05) 


Distribution  Means 


N 


L 


0  .  051 
0.055 


Table  9 


Mean  Estimated  Type  I  Error  Rates  as  a  Function  of 
Method.   Sample  Size  and  Distribution  (a=0.05) 


Size 


Distrb.      Method  40  80  ;  120 


L 


TT 

±.  J. 

051 

.  050 

.  048 

WT 

.051 

.051 

.048 

BT 

.051 

.050 

V  .049 

CTl 

.051 

.049 

.050 

CT2 

.051 

.049 

.051 

JT 

.056 

.052 

.052 

TT 

.051 

.049 

.049 

WT 

.050 

.049 

.049 

BT 

.093 

.079 

.  072 

CTl 

.050 

.050 

.048 

CT2 

.050 

.050 

.048 

JT 

.056 

.052 

.050 
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Table  10 

Mean  Estimated  Type  I  Error  Rates  as  a  Function  of 
Method  and  Sample  Size  (a=0.05) 


Size 


Method 

40 

80 

120 

TT 

.051 

.050 

.048 

WT 

.050 

.050 

.048 

BT 

.072 

.064 

.060 

CTl 

.051 

.049 

.049 

CT2 

.050 

.050 

.050 

JT 

.056 

.052 

.  051 
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the  Type  I  error  rate  for  the  BT  method  is  above  a  but 
improves  as  the  total  sample  size  increases.  This  is  primary 
because  of  the  elevated  Type  I  error  rates  for  BT  when  the 
data  are  lognormal .  For  small  total  sample  size,  the  JT 
method  also  tends  to  have  a  Type  I  error  rate  above  the 
nominal  level  of  significance. 

The  Mxn„/n„  and  Mxne/n„xD  effects.   In  Table  11,  results 
of  the  estimated  Type  I  error  rates  for  the  Mxn^/n^xD 
interaction  are  presented.  The  results  indicate  that,  when 
data  are  generated  from  the  lognormal  distribution.  Type  I 
error  rate  for  the  WT  and  BT  methods  increases  as  n^/n^ 
increases.  For  the  other  methods.   Type  I  error  rate  declines 
as  n^/n^    increases .  When  data  are  generated  from  the  normal 
distribution,   the  table  shows  that   (a)   the  Type  I  error 
rates  for  the  TT  and  WT  methods  do  not  appear  to  be  affected 
by  n^/n^,   and  (b)   the  Type  I  error  rate  for  the  BT  method 
is  smaller  for  n^/n^  =0.67  than  for  ne/nc=1.5,  while  for 
the  CTl,  CT2,  and  JT  methods  the  opposite  is  the  case. 
Algina,  Oshima,   and  Lin  (1994)   give  a  theoretical 
explanation  for  the  behavior  of  TT  and  WT,  when  data  are 
lognormal.  For  the  BT  method,  a  theoretical  explanation  is  , 
given  in  Chapter  4 .  Table  12  reports  the  means  for  the 
Mxng/n^    interaction.  Results  in  the  table  show  that  for  a 
balanced  design  (n^/n^^l) ,  the  BT  method  is  the  only  method 
with  substantially  inflated  Type  I  error  rates.  When 
n3/n^=0.67,  both  the  BT  and  JT  methods  have  inflated  Type  I 


Table  11 


Mean  Estimated  Type  I  Error  Rates  as  a  Function 
of  Method  and  Sample  Size  Ratio  and  Distribution 
(a=0.05) 


He/He 


Distrb.      Method  .67  l.O  1.5 


N 


TT 

.049 

.051 

.050 

WT 

.049 

.051 

.050 

BT 

.047 

.051 

.051 

CTl 

.053 

.051 

.046 

CT2 

.052 

.050 

.049 

JT 

.056 

.053 

.051 

TT 

.  055 

.047 

.047 

WT 

.043 

.  047 

.058 

BT 

.078 

.080 

.086 

CTl 

.053 

.  048 

.  047 

CT2 

.  054 

.048 

.047 

JT 

.  057 

.051 

.050 

Table  12 


Mean  Estimated  Type  I  Error  Rates  as  a  Function 
of  Method  and  Sample  Size  Ratio  (a=0.05) 


Method  .67  1.0  1.5 


TT  .052  .049  .048 

WT  .046  .049  .054 

BT  .062  .066  .069 

CTl  .053  .050  .046 

CT2  .053  .049  .048 

JT  .056  .052  '  .050 
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error  rates.  The  Type  I  error  rates  for  the  CTl  and  CT2 
methods  are  slightly  inflated  when  ng/n^=0.67  and  slightly 
deflated  when  n3/n^=1.5.  On  the  other  hand,   the  Type  I  error 
rates  for  the  WT  method  are  slightly  deflated  when  ne<n^  and 
slightly  inflated  when  n3>n^.  Type  I  error  rates  for  the  BT 
and  WT  methods  increase  as  n^/n^    increases,  while  for  the  ' 
other  methods  the  opposite  is  the  case.  This  is  due  to  the 
effect  of  the  lognormal  distribution. 

Power  Analyses 

In  this  section  power  results  are  presented  in  two 
categories:    (a)  power  for  variance  differences  only,  and  (b) 
power  for  mean  and  variance  differences.   In  the  first 
category,  power  is  investigated  when  there  is  only  a 
variance  difference  and  the  means  of  the  two  groups  are 
equal.  This  is  the  case  where  ^e=Mc  ^^id  Ce^^^^c-   I^i  the  second 
category,  power  is  investigated  when  there  are  mean  and 
variance  differences  between  the  two  groups.  This  is  the 
case  where  ii^j^ii^  and  a^^a^. 
Power  for  Variance  Differences  Only 

In  Table  13  a  summary  of  the  distribution  of  estimated 
power  is  presented,   for  conditions  in  which  only  the 
variances  are  different  between  the  two  groups.  Of  course 
the  TT  and  WT  methods  are  not  designed  to  detect  variance 
differences  and  some  would  view  the  power  estimates  for 
these  tests  as  estimated  Type  I  error  rates.  Results  in  the 
table  show  that  power  can  be  less  than  q;=0  . 05  for  all 
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Table  13 

Distribution  of  the  Estimated  Power  (Variance  Differences 
Only)   for  the  Six  Methods   (a  =0.05) 


Percentile 


Method 

MIN 

10 

25 

50 

75 

.  SO 

t 

MAX 

TT 

.013 

.026 

.033 

.054 

.073 

.117 

WT 

.  024 

.030 

.  041 

.050 

.  059 

.074 

.090 

BT 

.007 

.015 

.026 

.101 

.191 

.236 

.249 

CTl 

.000 

.000 

.003 

.070 

.391 

.650 

.899 

CT2 

.000 

.001 

.010 

.045 

.190 

.461 

.  746 

JT 

.000 

.001 

.016 

.  044 

.134 

.333 

.642 
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methods.  Then  there  is  little  difference  among  the  methods. 
When  power  is  larger  than  Qf=0.05,  the  WT  and  TT  methods  have 
power  near  o;,  whereas  the  other  methods  have  power  above  a. 
In  general,  the  methods  with  power  above  a  are  ordered  CTl, 
CT2,  JT,  and  BT  in  terms  of  power.  Tables  14  and  15  show  the 
distributions  of  estimated  power  when  data  are  from  the 
normal  and  lognormal  distributions,   respectively.  In 
general,   sampling  from  a  lognormal  distribution  appears  to 
depress  power  for  the  CTl,   CT2 ,  JT,   and  BT  methods. 

Analysis  of  variance   (ANOVA)  was  conducted  to 
investigate  the  effect  on  the  estimated  power  of  the 
following  factors:  total  sample  size   (N) ,   sample  size  ratio 
(n^/n^)  ,   standard  deviation  ratio   (a^/a^),   distribution  (D)  , 
and  method  (M) .  Because  there  were  many  significant  main 
and  interaction  effects  only  the  effects  which  contributed 
to  more  than  1%  of  the  total  variance  were  considered  for 
interpretation  purposes.  Table  16  presents  these  effects  and 
the  percentage  of  variances.  The  results  for  power  for  tests 
conducted  at  q?=0.01  and  a=0.10  are  similar  to  those  reported 
in  Table  16.  Variance  components  for  these  tests  are 
reported  in  Appendix  B. 

The  0^1  a ^.  M.   and  Mxg^/g^  effects.  Results  for  the 
Mxae/a^  interaction  are  shown  in  Table  17.  The  table  shows 
that  as  expected,   the  alternative  methods   (BT,   CTl,   CT2,  and 
JT)  have  low  power  when  c^<(5^.  The  alternative  methods  are 
designed  for  use  when    o^-^a^  and  consequently  are  not 


Table  14 

Distributions  of  Estimated  Power  (Variance  Differences  Only) 
for  the  Six  Methods:  Normal  Distribution  (q!=0.05) 


Percentile 


Method 

MIN 

10 

25 

50 

75 

90 

MAX 

TT 

.025 

.029 

.033 

.053 

.073 

.083 

.087 

WT 

.043 

.046 

.048 

.050 

.052 

.054 

.056 

BT 

.007 

.014 

.017 

.079 

.183 

.234 

.249 

CTl 

.000 

.000 

.000 

.138 

.574 

.749 

.899 

CT2 

.000 

.000 

.001 

.  079 

.416 

.577 

.  746 

JT 

.000 

.000 

.002 

.067 

.331 

.482 

.642 
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Table  15 

Distributions  of  Estimated  Power  (Variance  Differences  Only) 
for  the  Six  Methods:  Lognormal  Distribution  (g^O.OS) 


Percentile 


Method 

MIN 

10 

25 

50 

75 

90 

MAX 

TT 

.013 

.016 

.032 

.056 

.072 

.106 

.  117 

WT 

.024 

.027 

.031 

.050 

.072 

.081 

.090 

BT 

.  021 

.030 

.041 

.111 

.199 

.236 

.243 

CTl 

.001 

.002 

.006 

.  070 

.235 

.367 

.468 

CT2 

.006 

.011 

.020 

.045 

.103 

.148 

.240 

JT 

.  012 

.020 

.031 

.044 

.065 

.093 

.145 

Table  16 

Percent  of  Total  Variance  for  Estimated 
Power  (Variance  Differences  Only)  Effects 
Accounting  ^1%  of  the  Variance  (q;=0.05) 


Effect  Percentage 


N 

"1     c  c\ 

1 . 59 

MxN 

2  .  07 

MxNxae/cTc 

2  .35 

Nxae/cTc 

2  .42 

D 

4  .34 

MxcTe/a^xD 

5  .45 

MxD 

5.58 

a^/cr^xD 

7.88 

M 

11.73 

24.54 

a  J  a. 

28.01 
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Table  17 

Mean  Estimated  Power  (Variance  Differences  Only) 
as  a  Function  of  Method  and  Standard  Deviation 
Ratio  (q!=0.05) 


Method  1/3  1/2  2  3 


TT 
WT 
BT 

CTl 
CT2 
JT 


068 
064 
027 
004 
009 
015 


.062 
.060 
.033 
.007 
.015 
.022 


043 
041 
154 
337 
215 
167 


.  046 
.040 
.230 
.515 
.318 
.242 
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expected  to  have  good  power  when  (J^<(r^  regardless  of  the 
differences  between       and  a^.     The  alternative  methods  have 
better  power  when  a^>a^,   since  the  alternative  methods  are 
designed  to  detect  o^x^c-  Estimates  for  the  traditional 
tests   (TT  and  WT)   are  in  actuality  Type  I  error  rates  and 
reflect  the  effects  of  a^/o^  on  these  rates  reported  in 
Algina,  Oshima,  and  Lin  (1994) .  Marginal  estimated  power 
means  for  the  ff^/a^  effect  are  reported  in  Table  18.  As 
expected  from  Table  17,  results  in  the  table  indicate  that 
power  when  <Js<o^  is  very  low,   and  power  improves  as  o^/a^ 
increases.   In  Table  19,  means  of  the  estimated  power  for  M 
are  presented.  Power  estimates  for  the  alternative  methods 
are  low  because  power  is  averaged  for  a^<a^  and  cf^>a^.  Of  the 
four  alternative  methods,   the  CTl  method  appears  to  have  the 
best  power. 

The  MxD  and  Mxg^/g„xD  effects.  Table  2  0  gives  results 
for  the  Mxa^/o^xD  interaction.  The  behavior  of  TT  and  WT 
reflect  the  influence  of  a^/a^  and  D  reported  in  Algina, 
Oshima,   and  Lin  (1994) .  Power  for  the  alternative  methods  is 
slightly  lower  for  the  lognormal  distribution  than  for  the 
normal  distribution.  An  exception  is  the  BT  method  which  has 
higher  power  for  the  lognormal  distribution  than  for  the 
normal  distribution.  This  trend  follows  the  effect  of 
lognormality  on  the  Type  I  error  rate  for  BT.  Mean  estimated 
power  values    for  the  MxD  interaction  are  presented  in  Table 
21.  Following  the  results  in  Table  20,   these  results  show 
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Table  18 

Mean  Estimated  Power  (Variance 
Differences  Only)   as  a  Function 
of  Standard  Deviation  Ratio 
(a=0.05) 


ffg/ffc  Means 


1/3 


.031 


1/2 


.033 


2 


.160 


3 


.232 


Table  19 

Mean  Estimated  Power  (Variance 


Differences  Only)  as  a  Function 
of  Method  (q;=0.05) 


Method  Means 


TT 
WT 
BT 

CTl 
CT2 
JT 


.  054 
.051 
.  Ill 
.216 
.140 
.112 


Table  20 

Mean  Estimated  Power  (Variance  Differences  Only)  as  a 


Function  of  Method.  Standard  Deviation  Ratio  and 


Distribution  (o;=0.05) 


Disrtrb.     Method        1/3  1/2 


N  TT  .054  .053  .051  .055 

WT  .050  .051  .049  .051 

BT  .015  .020  .143  .227 

CTl  .001  .002  .478  .704 

CT2  .001  .004  .341  .504 

JT  .002  .006  .277  .405 

L  TT  .081  .071  .035  .036 

WT  .078  .069  .033  .030 

BT  .040  .045  .165  .233 

CTl  .007  .011  .196  .325 

CT2  .018  .026  .090  .133 

JT  .028  .039  .058  .079 


Table  21 

Mean  Estimated  Power  (Variance 


Differences  Only)  as  a  Function  of 
Method  and  Distribution  (q'=0.05) 


Distribution 


Method  N  L 


TT  .053  .056 

WT  .050  .052 

BT  .101  .120 

CTl  .296  .135 

CT2  .212  .066 

JT  .172  .051 


that  the  CTl,   CT2  and  JT  methods  have  better  power  when  data 
are  normally  distributed  than  when  the  data  are  lognormally 
distributed.  The  BT  method  shows  slightly  higher  power  when 
data  are  from  the  lognormal  distribution  than  when  the  data 
are  from  the  normal  distribution. 

The  MxN  and  MxNxg^/g^  effects.  In  Table  22  estimated 
means  for  the  MxNxag/a^    interaction  are  presented.  These 
results  indicate  that  when  Oe<(y^,  the  alternative  methods 
show  low  power,  and  the  power  becomes  lower  as  the  total 
sample  size  increases.  When  a^>a^,  power  for  the  alternative 
methods  is  higher,  and  improves  as  the  total  sample  size 
increases.  When  c^xj^,  the  BT  method  appears  not  to  be 
affected  by  the  total  sample  size.  But  when  (J^<a^,   the  power 
for  the  BT  method  declines  as  the  total  sample  size 
increases.  Thus,  the  alternative  methods  are  recommended 
when  (TeXTc-  Table  23  presents  results  for  the  MxN 
interaction.  Power  for  the  alternative  methods  appear  to  be 
low  for  small  total  sample  size,  but  improves  as  the  total 
sample  size  increases.  The  only  exception  is  the  BT  method 
which  declines  in  power  as  the  total  sample  size  increases. 
As  expected,  the  estimates  reported  for  the  TT  and  WT 
methods  converges  to  cx,   as  the  total  sample  size  increases. 

The  N  and  Nxg^/g^  effects.  Tables  24  and  25  display  the 
results  for  interpreting  the  IJxa^/a^  interaction  and  the  N 
main    effect.  Results  in  Table  24  indicate  that  when  <J^<a^, 
power  is  low  and  becomes  worse  as  the  total  sample  size  is 


Table  22 

Mean  Estimated  Power  (Variance  Differences  Only) 
as  a  Function  of  Method,   Sample  Size  and  Standard 
Deviation  Ratio  (q;=0.05) 


Size  Method        1/3  1/2  2  3 


TT 

.072 

.066 

.042 

.045 

WT 

.068 

.064 

.  041 

.039 

BT 

.031 

.038 

.  154 

.232 

CTl 

.008 

.013 

.212 

.341 

CT2 

.016 

.024 

.  124 

.186 

JT 

.024 

.034 

.  102 

.  147 

TT 

.067 

.060 

.043 

.  045 

WT 

,064 

.058 

.041 

.039 

BT 

.027 

.030 

.154 

.230 

CTl 

.002 

.004 

.347 

.538 

CT2 

.008 

.012 

.220 

.328 

JT 

.013 

.019 

.168 

.245 

TT 

.064 

.061 

.043 

.  047 

WT 

.061 

.059 

.041 

.  042 

BT 

.024 

.030 

.  154 

.228 

CTl 

.001 

.003 

.454 

.666 

CT2 

.004 

.008 

.302 

.442 

JT 

.009 

.014 

.232 

.335 

Table  23 

Mean  Estimated  Power  (Variance  Differences 
Only)  as  a  Function  of  Method  and  Total 
Sample  Size  (o;=0.05) 


Size 


Method 

40 

80 

120 

TT 

.056 

.054 

.  054 

WT 

.053 

.051 

.  051 

BT 

.114 

.110 

.109 

CTl 

.143 

.223 

.281 

CT2 

.087 

.142 

.189 

JT 

.077 

.111 

.147 

Table  24 

Mean  Estimated  Power  (Variance  Differences 
Only)   as  a  Function  of  Sample  Size  and 
Standard  Deviation  Ratio  (a=0.05) 


Size  1/3  1/2  2  3 

40  .036  .040  .112  .165 

80  .030  .030  .162  .238 

120  .027  .029  .204  .293 
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Table  25 


Mean  Estimated  Power 

(Variance 

Differences  Only)  as 

a  Function 

of  Total  Samcle  Size 

(Q!=0.05) 

Size 

Means 

40 

.088 

80 

.115 

120 

.138 
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increased.  However,  when  a^>a^,  power  is  moderate  and 
improves  as  the  total  sample  size  is  increased.  Results  for 
the  total  sample  size  are  displayed  in  Table  25.  The  results 
do  not  provide  any  new  information  about  the  effect  of  N. 

The  D  and  Dxg^/g^  effects.  Shown  in  Table  26  are  means 
for  interpreting  the  Dxffe/a^  interaction.  As  may  be  seen 
from  the  table,  the  results  indicate  that  when  o^<a^,  power 
is  generally  low,  but    power  for  the  lognormal  case  is 
better  than  for  the  normal  case.  However,  when  a^>a^,  power 
is  better,  and  power  for  the  normal  case  is  better  than 
power  for  the  lognormal  case.   In  Table  27,   the  results  of 
the  distribution    effect  are  shown.  The  results  indicate 
that  power  is  better  when  sampling  is  from  the  normal 
distribution  than  when  sampling  is  from  the  lognormal 
distribution. 

Power  for  Mean  and  Variance  Differences 

Table  2  8  presents  a  summary  of  the  distribution  of 
estimated  power  for  the  six  methods,  when  there  are  mean  and 
variance  differences  between  the  two  groups.  These  results 
show  that  the  alternative  methods  have  better  power  than  the 
traditional   (TT  and  WT)  methods.  Tables  29  and  30  present  a 
summary  of  the  distributions  of  estimated  power  when  data 
are  normal  and  lognormal,  respectively.  These  two  tables 
show  that  the  alternative  methods  have  higher  power  when 
data  are  normal  than 
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Table  26 

Mean  Estimated  Power  (Variance  Differences  Only) 

as  a  Function  of  Standard  Deviation  Ratio  and 
Distribution  (o;=0.05) 


Distrb  1/3  1/2  2  3 


N 
L 


.020  .023  .223  .324 

.081  .043  .096  .139 


Table  27 


Mean  Estimated  Power 

(Variance 

Differences  Only)  as 

a  Function 

of  Distribution  (q!=0 

05) 

Distrb. 

Means 

N 

.148 

L 

.080 
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Table  28 

Distribution  of  Estimated  Power  (Mean  and  Variance 
Differences) 

(Q!=:0  . 05) 


Percentile 


Method     MIN         10  25  50  75  90  MAX 


TT  .091  .185  .242  .321  .428  .583  .644 

WT  .111  .182  .244  .320  .420  .582  .660 

BT  .051  .130  .204  .475  .601  .728  .814 

CTl  .000  .008  .038  .336  .762  .939  .994 

CT2  .000  .014  .074  .299  .636  .848  .961 

JT  .000  .022  .104  .284  .590  .795  .936 
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Table  29 

Distributions  of  Estimated  Power  (Mean  and  Variance 
Differences)   for  the  Six  Methods:  Normal  Distribution 
(a=0.05) 


Percentile 


Method 

MIN 

10 

25 

50 

75 

90 

MAX 

TT 

.  125 

.185 

.239 

.318 

.425 

.579 

.625 

WT 

.158 

.181 

.242 

.309 

.412 

.574 

.637 

BT 

.  051 

.093 

.  164 

.453 

.607 

.732 

.814 

CTl 

.000 

.001 

.  014 

.394 

.  909 

.970 

.994 

CT2 

.000 

.004 

.023 

.357 

.  821 

.914 

.961 

JT 

.000 

.006 

.035 

.349 

.770 

.871 

.936 
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Table  30 

Distributions  of  Estimated  Power  (Mean  and  Variance 
Differences)   for  the  Six  Methods:  Lognormal  Distribution 
(a^O.05) 


Percentile 


Method 

MIN 

10 

25 

50 

75 

90 

MAX 

TT 

.091 

.182 

.253 

.340 

.432 

.588 

.  644 

WT 

.  Ill 

.182 

.249 

.326 

.431 

.585 

.660 

BT 

.089 

.160 

.250 

.475 

.601 

.728 

.  791 

CTl 

.011 

.036 

.073 

.337 

.636 

.759 

.846 

CT2 

.028 

.075 

.136 

.299 

.460 

.621 

.  747 

JT 

.048 

.109 

.179 

.270 

.403 

.496 

.684 
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when  data  are  lognormal,  but  the  opposite  is  the  case  for 
the  traditional  methods. 

Analysis  of  variance  (ANOVA)  was  conducted  to 
investigate  the  effect  on  the  power  of  the  following 
factors:  total  sample  size   (N) ,   sample  size  ratio   (n^/n^)  , 
standard  deviation  ratio  {a^/a^)  ,  distribution  (D) ,  mean 
differences/actual  power  (P) ,  and  method  (M) .  Only  the 
effects  which  contributed  to  more  than  1%  of  the  total 
variance  were  considered  for  interpretation.  Table  31  shows 
the  effects  that  accounted  for  more  than  1%  of  the  total 
variance.  The  results  for  power  for  tests  conducted  at 
a=0.01  and  Qf=0.10  are  similar  to  those  reported  in  Table  31. 
Variance  components  for  these  tests  are  reported  in  Appendix 
B. 

The  gg/g^  and  Mxg^/g^  effects.  Table  32  presents  means  . 
for  interpreting  the  Mxa^/a^  interaction.  These  results  show 
that,  except  for  the  CTl  method,   the  methods  achieve  the 
highest  power  when  o^=(s^.  The  alternative  methods  are 
designed  for  use  when  a^^a^.  As  a  result,  when  a^^Q^,  power 
for  the  traditional  methods  is  better  than  power  for  the 
alternative  methods.  However,  when  G^>a^,   the  opposite  is 
the  case.  Of  the  four  alternative  methods,  when  o^>a^,  the 
CTl  method  appears  to  have  the  highest  power.  Also,  unlike 
the  other  methods,  power  for  the  CTl  method  increases  as  the 
standard  deviation  ratio  increases .  The  decline  in  power  for 
the  BT  method  is  explained  theoretically  in  Chapter  4.  The 
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I 


Table  31 

Percent  of  Total  Variance  for 
Estimated  Power  (Mean  and 
Variance  Differences)  Effects 
Accounting  ^1%  of  the  Variance 
(q!=0  .05) 


Effect  Percentage 


ffe/a^xP  2.10 
Mxffg/a^xD  2.56 


4  .  08 


P 


12  . 16 


Mxffe/cr^ 


22  .36 


50  .  84 
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Table  32 

Mean  Estimated  Power  (Mean  and  Variance  Differences)  as  a 
Function  of  Method  and  Standard  Deviation  Ratio  (q;=0.05) 


a  Jo, 


Method 

1/3 

1/2 

1 

2 

3 

TT 

.293 

.433 

.704 

.413 

.252 

WT 

.292 

.433 

.703 

.412 

.249 

BT 

.157 

.294 

.689 

.634 

.596 

CTl 

.028 

.088 

.569 

.739 

.773 

CT2 

.056 

.146 

.634 

.651 

.609 

JT 

.078 

.190 

.670 

.603 

.526 
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TT  and  WT  methods  show  similar  power  regardless  of  the 
standard  deviation  ratio.  Shown  in  Table  33  are  the  results 
of  the  marginal  mean  estimated  power  for  the  o^la^  effect. 
The  results  indicate  that  power  is  low  for  the  negative 
condition  {a^<a^)  and  moderate  for  the  positive  condition 
(o'e^o'c)  •  the  positive  condition,  power  declines  as  the 

standard  deviation  ratio  increases. 

The  g„/g„xD  and  Mxa^/g„xD  effects.  Table  34  shows  the 
cell  means  for  the  Mxffe/a^xD  interaction.  When  a^<(5^,  as 
expected,  the  traditional  methods  have  higher  power  than  the 
alternative  methods,   for  both  normal  and  lognormal  data. 
This  is  because  alternative  methods  were  not  designed  for 
the  case  <^^<cs^.  When  a ^=(5^,   the  traditional  are  still  more 
powerful  than  the  alternative  methods,  with  the  TT  method 
showing  the  highest  power.   It  is  well  known  that  from  theory 
that,  when  o^=o^  and  data  is  normal,   the  TT  method  is  a 
uniformly  powerful  method.  When  cs^>a^,   as  expected,  the 
alternative  methods  are  more  powerful  than  the  traditional 
methods,  with  the  CTl  method  showing  the  highest  power.  This 
is  because  the  alternative  methods  are  designed  for  use  when 
a^>a^.  In  terms  of  power,  when  a^>c^,  the  order  of  the 
alternative  methods  is  CTl,   CT2 ,  BT  and  JT.  Results  in  the 
table  also  show  that  when  o^^Q^,   the  TT,WT,   BT  and  JT 
methods  have  better  power  when  data  are  generated  from  the 
lognormal  distribution  than  when  data  are  generated  from  the 
normal  distribution.  However,  when  a^>a^,   all  the  methods 
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Table  33 

Mean  Estimated  Power  (Mean 
and  Variance  Differences) 
as  a  Function  of  Standard 
Deviation  Ratio  (q!=0.05) 


ffe/t^c  Means 


1/3 

.151 

1/2 

.264 

1 

.662 

2 

.576 

3 

.501 
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Table  34 

Mean  Estimated  Power  (Mean  and  Variance  Differences)  as  a 
Function  of  Method.  Standard  Deviation  Ratio  and 
Distribution  (a=0.05) 


D 

M 

1/3 

1/2 

1 

2 

3 

N 

TT 

.268 

.416 

.700 

.416 

.266 

WT 

.265 

.415 

.698 

.415 

.265 

BT 

.122 

.262 

.692 

.637 

.601 

CTl 

.009 

.047 

.605 

.859 

.901 

CT2 

.015 

.071 

.640 

.  792 

.  792 

JT 

.022 

.097 

.663 

.  752 

.  725 

L 

TT 

.319 

.450 

.709 

.411 

.237 

WT 

.318 

.451 

.708 

.410 

.233 

BT 

.193 

.325 

.686 

.631 

.592 

CTl 

.048 

.128 

.533 

.  618 

.646 

CT2 

.096 

.220 

.628 

.511 

.427 

JT 

.134 

.284 

.  678 

.454 

.328 

have  better  power  when  data  are  normal  than  when  data  are 
lognormal .  For  all  the  methods,  when  (Je=ac>   the  power 
difference  between  distributions  is  very  small.  In  Table  35 
results  of  the  a^/a^xD  interaction  are  displayed.  These 
results  indicate  that  when  (r^<a^,  power  is  better  when  data 
are  lognormal  than  when  data  are  normal,  but  the  opposite  i 
the  case  when  a^^a^. 

The  P  and  Pxg^/g„  effects.  Table  36  shows  the  means  for 
interpreting  the  Pxa^/a^  interaction.  The  results  indicate 
that  qualitatively  the  influence  of  a^/a^  on  power  is  the 
same  for  all  levels  of  target  power.  Also,  estimated  power 
increases  as  the  target  power  increases.  Table  37  shows  the 
means  for  interpreting  the  P  main  effect.  The  table  shows 
that  estimated  power  increases  as    the  target  power 
increases,  but  the  estimated  power  is  much  lower  than  the 
target  power.  This  is  due  to  the  fact  that  the  estimated 
power  is  averaged  over  other  factors,   some  of  which  have  a 
negative  impact  on  the  estimated  power. 

Summary 

Results  of  this  study  have  shown  that: 

1.  By  Bradley's   (1978)   liberal  criterion,  all  the 

methods  investigated  maintained  good  control  of  the  Type  I 

error  rates, 

except  for  the  BT  method  which  exhibited  substantially 
larger  Type  I  error  rates  than  the  other  methods  when  data 
were  lognormal . 
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Table  35 

Mean  Estimated  Power  (Mean  and  Variance  Differences)  as  a 
Function  of  Standard  Deviation  Ratio  and 
Distribution  ia=0 . 05) 


D  1/3  1/2  1  2  3 


N  .117  .218  .666  .645  .592 

L  .185  .310  .657  .506  .411 
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Table  36 

Mean  Estimated  Power  (Mean  and  Variance  Differences)  as  a 
Function  of  Standard  Deviation  Ratio  and  Actual 
Power  (q;=0  . 05) 


P  1/3  1/2  1  2  3 


.5  .104  .171  .471  .445  .417 

.7  .141  .248  .658  .559  .489 

.9  .207  .373  .858  .723  .593 
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Table  37 

Mean  Estimated  Power  (Mean  and 
Variance  Difference)  as  a 
Function  of  Actual  Power 
(q;=0  . 05) 


Power  Means 

.5  .322 

.7  .419 

.9  .551 


2.  In  general,   all  the  methods  performed  better,  in 
terms  of  Type  I  error  rates  and  power,  when  the  data  were 
generated  from  the  normal  distribution  than  when  the  data 
were  generated  from  the  lognormal  distribution. 

3.  When  o^<a^,  the  power  was  low  and  the  traditional 
methods  were  more  powerful  than  the  alternative  methods. 
When  a^=a^,   the  the  power  was  higher  and  the  traditional 
methods  were  still  more  powerful  than  the  alternative 
methods.  Finally,  when  o^>a^,  the  alternative  methods  were 
more  powerful  than  the  traditional  methods. 


CHAPTER  4 
CONCLUSIONS 


The  purpose  of  this  study  was  to  investigate  Type  I 
error  rates  and  power  of  some  alternatives  to  the 
independent  samples  t-test  when  a  difference  in  means  is 
accompanied  by  a  difference  in  variances .  Three  hundred  and 
sixty  simulated  conditions  were  used  to  investigate  the 
effects  of  several  factors  on  the  Type  I  error  rates  and 
power  of  the  methods.  The  results  of  the  study  are  intended 
to  provide  researchers  with  some  guidelines  for  comparing 
the  means  of  two  populations  when  a  difference  in  means  is 
accompanied  by  a  difference  in  variances.  However,  the 
generalizability  of  the  results  is  limited  by  the  range  of 
values  of  the  total  sample  size,   sample  size  ratio,  standard 
deviation  ratio,  mean  difference  and  distribution. 


Conclusions 

Within  the  limitations  of  the  study,   the  following 
findings  of  the  present  study  can  be  made: 

Conclusion  1 .  All  the  methods  maintained  control  of  the 
Type  I  error  rates,  except  for  the  BT  method,  which  does  not 
control  the  Type  I  error  rate  under  lognormality . 

Conclusion  2 .  All  the  alternative  methods  had  smaller 
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Type  I  error  rates  when  n^>n^  than  when  ne<n<,,  except  BT  in 
which  the  opposite  was  true. 

Conclusion  3 .  When  o^>a^,   the  alternative  methods  had 
better  power  than  the  traditional  methods,  but  when  ae<(^c' 
the  opposite  was  true.  This  was  true  for  both  the  case  when 
only  a  variance  difference  existed  between  the  two  groups, 
and  when  there  was  a  mean  and  variance  difference  between 
the  two  groups.  Among  the  alternative  methods,  CTl  had  the 
best  power. 

Conclusion  4 .  For  all  the  methods,  except  for  CTl, 
power  was  the  highest  when  Oe=Cc  arid  ii^^fx^.  In  addition,  when 
a^=a^  and  jx^^ix^,  power  for  the  TT  and  WT  methods  was  better 
than  power  for  the  alternative  methods. 

Conclusion  5.  Power  was  better  when  the  data  were 
sampled  from  the  normal  distribution  than  when  the  data  was 
sampled  from  the  lognormal  distribution. 

Conclusion  6 .  When  a^-za^,  power  for  all  the  alternative 
methods  except  for  the  CTl  method,  declined  as  the  standard 
deviation  ratio  increased.  This  suggests  that  the 
alternative  methods  perform  well  to  a  certain  degree  of  the 
differences  between  the  variances  of  the  two  groups . 
However,   it  should  be  noted  that  when  a^>a^  the  power  of  the 
traditional  methods  declined  more  sharply  than  did  the 
alternative  methods .  .  -  - 
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Theoretical  Explanations  of  Selected  Results 
Explanation  of  Conclusion  1  for  BT  Method 

Results  in  this  study  have  shown  that  the  BT  method  has 
inflated  Type  I  error  rates  when  data  are  sampled  from  the 
lognorroal  distribution.  According  to  Algina,  Oshima,   and  Lin 
(1994) ,   for  non-normal  data,   the  Type  I  error  rate  depends 
on  the  sampling  covariance  between  the  numerator  and  the 
square  of  the  denominator  for  the  test  statistic.  When  the 
covariance  is  not  equal  to  zero,   extreme  mean  differences 
are  associated  with  small  standard  errors .  For  the  one 
tailed  test,   as  in  this  study,   the  Type  I  error  rate  depends 
on  the  sign  of  the  sampling  covariance  and  the  tail  of  the 
test.  Upper  tailed  tests  tend  to  have  estimated  Type  I  error 
rate  larger  than  the  nominal  rate  when  the  sampling 
covariance  is  negative,   and  estimated  Type  I  error  rate 
smaller  than  the  nominal  rate  when  the  sampling  covariance 
is  positive. 

From  Kendall  and  Stuart   (1973) ,   the  sampling  covariance 
between  the  mean  and  variance  for  a  single  sample  is  jUj/n, 
where  /X3  is  the  third  central  moment  and  n  is  the  total 
sample  size.  Using  this  result,   from  Equation  35,  the 
covariance  between  the  numerator  and  the  square  of  the 
denominator  for  the  BT  method  is  given  by 
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where  y-i=l^2/<^^-  Since  cTbt  is  negative  and  the  test  is  upper 
tailed,  the  estimated  Type  I  error  rate  is  larger  than  the 
nominal  significance  level .  This  explains  why  the  BT  method 
has  inflated  Type  I  error  rates  when  data  is  sampled  from 
the  lognormal  distribution,   as  shown  in  Table  11. 

Explanation  of  Conclusion  2  for  BT  Method 

Algina,  Oshima,  and  Lin  (1994)     showed  that  the 
discrepancies  between  the  estimated  Type  I  error  rate  and 
the  nominal  significance  level  are  larger  for  larger 
sampling  covariance.  For  fixed  N,   l/n^d/n^  +  l/n^)  is 
smaller  when  n^>n^  than  when  ne=n^  or  n^>ne.  Therefore,  as 
n^/n^  increases,   agx  also  increases  and  hence  the  estimated 
Type  I  error  rate  also  increases.  This  explains  the  increase 
in  Type  I  error  rate  for  the  BT  method  as  n^/n^  increases, 
as  shown  in  Table  12 . 

Explanation  of  Conclusion  6  for  BT  Method 

For  conditions  in  which  a^<a^,   a^=1.0  and  increases 
as  (Te/'^c  declines.  From  Equation  35,   the  denominator  for  BT 
is 


^ 
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Thus  as  o^la^  declines  the  denominator  of  BT  increases  and 
consequently  power  declines.  For  conditions  in  which  a^>a^, 
=1.0.   In  Equation  35,  notice  that  the  denominator  is  not 
a  function  of  the  standard  deviation  for  the  experimental 
group,   ffg.  However,  Brownie,  Boos  and  Hughes-Oliver  (1990) 
have  shown  that,  under  normality,   the  power  function  for  BT 
is 


where  p  =  a^la^,  and  tla/n^-l)   is  the  1-a  percentile  of 
Student's  t  distribution  with  (n^-l)  degrees  of  freedom  and 


6  ''<^ 


[   ^  +  *^        1  ]  1/2 


Calculations  show  that  for  conditions  in  which  power  for  TT 
was   .50,  under  normality,   ae/a^sl.O    has  little  effect  on 
the  power  for  BT.  For  conditions  in  which  power  for  TT  was 
.70  or  .90,  under  normality,   as  Ce/a^sl.O  increased,  power 
for  BT  declined. 

Comparisons  to  Previous  Studies 
Conover  and  Salsburg  (1988)  used  several  sets  of  data 
from  biometrics  experiments  to  compare  several  methods 
including  the  TT,  CTl  and  CT2  methods.  In  each  case,  their 
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results  showed  that  the  CTl  and  CT2  methods  had  better  power 
than  the  TT  method.     Results  in  this  study  are  consistent 
with  the  findings  of  Conover  and  Salsburg.  As  can  be  seen  in 
Table  32,  when  a^>a^,  the  two  methods  suggested  by  Conover 
and  Salsburg  are  superior  to  the  independent  samples  t-test. 

Brownie  et  al .    (1990)  compared  the  TT  method  and  the  BT 
method.  Using  power  plots,  they  showed  that 

(1)  Power  for  the  BT  method  was  better  than  the  TT 
method . 

(2)  Power  gains  increased  as  the  standard  deviation 
ratio  increased. 

(3)  Power  gains  increased  at  a  faster  rate  for  n^=n^ 
than  for  n^/  n^. 

Results  of  this  study  also  verified  the  superiority  of  the 
BT  method  over  the  TT  method  (see  Table  32) .  As  can  be  seen 
in  Table    32,  power  gains  increased  with  an  increase  in  the 
standard  deviation  ratio.  Thus,  the  results  from  this  study 
are  consistent  with  the  results  from  the  Brownie  et  al . 
study . 

As  noted  in  Chapter  1,  Blair  and  Sawilowsky  (1993) 
found  that,   for  non-normal  data,   the  TT  method  was  more 
powerful  than  the  BT  method,  when  ^^=0^.  However,  when  G^>a^, 
the  BT  method  was  more  powerful  than  the  TT  method.  Also, 
for  non-normal  data,   the  TT  method  had  better  control  of  the 
Type  I  error  rate  than  the  BT  method.  Results  in  the  study 
are  consistent  with  the  results  from  Blair  and  Sawilowsky. 
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Results  in  Table  6  show  that,  when  data  are  lognormal,  the 
TT  method  has  better  control  of  the  Type  I  error  rate  than 
the  BT  method.  In  terms  of  power,  Table  34  shows  that,  when 
c^=a^  and  data  are  lognormal,  the  TT  method  is  more  powerful 
than  the  BT  method.  The  table  also  shows  that,  when  a^>a^, 
the  BT  method  is  more  powerful  than  the  TT  method. 

Johnson  at  al .    (1987)   showed  that  the  JT  method  had 
control  of  Type  I  error  rates.  Also,   in  their  study,  they 
showed  that  power  increased  as  the  total  sample  size 
increased.  Table  23  shows  that  the  power  increases  with  an 
increase  in  total  sample  size.  Thus,  results  of  this  study 
are  consistent  with  the  Johnson  et  al .  findings. 

Suggestions  for  Future  Research 
As  mentioned  above,  generalizability  of  the  results  in 
this  study  limited  by  the  range  of  values  for  (a)  total 
sample  size,    (b)  distribution,    (c)   standard  deviation  ratio, 
(d)  mean  difference  and  (e)   sample  size  ratio.  Results  in 
the  study  have  shown  that  the  total  sample  size  did  not  have 
a  significant  impact  on  power  of  the  methods  investigated  in 
the  study,  when  there  is  a  mean  and  variance  difference 
between  the  two  groups.  Also,   in  the  literature,  most  of  the 
alternative  methods  were  applied  to  relatively  small  total 
sample  size.  Thus,   further  research  needs  to  be  conducted  to 
see  how  the  Type  I  error  rates  and  power  of  the  methods  are 
affected  when  the  total  sample  size  is  small. 
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With  one  exception,  results  in  the  study  have  shown 
that  as  the  standard  deviation  increases,  power  for  the 
alternative  methods  starts  to  decline.  As  Stevens   (1979)  and 
Wilcox  (1987)  have  shown,  data  in  which  the  standard 
deviation  ratios  are  larger  than  those  investigated  in  this 
study,  do  occur  in  practice.  Thus,   further  research  is 
needed  to  examine  the  extent  to  which  the  standard  deviation 
ratio  can  be  increased  before  the  alternative  methods  fail . 

This  study  included  only  data  sampled  from  the  normal 
and  lognormal  distributions.     In  general,   results  from  the 
study  showed  that  the  methods  did  not  perform  well  for  the 
lognormal  distribution.  Even  though  Miceri's   (1989)  results 
gave  evidence  that  the  distributions  in  this  study  are  not 
unrepresentative  of  distributions  found  in  practice,  further 
research  in  this  area  is  needed  to  examine  the  effect  of 
other  non-normal  distributions  on  the  power  of  the 
alternative  methods.  In  particular,   further  research  is 
needed  to  investigate  the  effects  of  skewness  and  kurtosis 
on  the  alternative  methods. 

Finally,   in  this  study,   for  the  analysis  of  the  JT 
method,   A/cr  was  set  to  0.6.  However,   as  Table  38  shows,  the 
power  of  JT,   as  a  function  of  a^/a^,   is  affected  by  the 
choice  of  A/a.  When  a^=a^,   the  highest  power  is  achieved 
when  A/a=.2.  However,   for  a^>a^,  high  power  is  achieved  at 
higher  levels  of  A/a.  This  suggests  that,   in  order  to 
achieve  better  power  when  using  the  JT,  researchers  might 
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Table  38 

Mean  Estimated  Power  (Mean  and  Variance  Differences)   for  the 
JT  method  as  Function  of  Target  Power.   Standard  Deviation 
Ratio  and  A/g  (a=0.05) 


P         A/a  1/3  1/2  1  2  3 


.  2 

.  095 

.  179 

.  502 

.  353 

.247 

.  4 

.  050 

.  123 

.489 

AAA 

.  444 

.  3  64 

.  6 

.  027 

.  078 

.480 

.522 

.476 

.8 

.016 

.055 

.460 

.581 

.576 

1 

.009 

.039 

.440 

.638 

.662 

.2 

.130 

.271 

.682 

.448 

.333 

.4 

.070 

.201 

.672 

.541 

.456 

.6 

.038 

.137 

.652 

.623 

.560 

.8 

.021 

.095 

.631 

.692 

.652 

1 

.013 

.072 

.600 

.739 

.734 

.2 

.212 

.440 

.894 

.640 

.442 

.4 

.133 

.343 

.883 

.721 

.561 

.6 

.080 

.255 

.867 

.783 

.670 

.8 

.047 

.  187 

.  847 

.833 

.  760 

1 

.  030 

.137 

.  821 

.  865 

.825 

have  to  use  different  values  of  A/cr  depending  on  the 
standard  deviation  ration.  Thus,   further  research  is  needed 
to  investigate  combinations  of  A/cr  and  o^la^  for  the  best 
power . 


APPENDIX  A 
ESTIMATED  TYPE  I  ERROR  RATES  AND  POWER 


Table  39 

Estimated  Type  I  error  rates  and  Power  When  q;=0.05 


N 

a  J  a 

C 

P 

D 

TT 

WT 

BT 

CTl 

CT2 

JT 

40 

1.00 

0. 

33 

0. 

0 

N 

.052 

.052 

.015 

.002 

.004 

.005 

40 

1.00 

0. 

50 

0. 

0 

N 

.  054 

.052 

.023 

.008 

.  012 

.  015 

40 

1.00 

1. 

00 

0  . 

0 

N 

.049 

.049 

.052 

.051 

.049 

.  054 

40 

1.00 

2  . 

00 

0  . 

0 

N 

.055 

.054 

.143 

.299 

.193 

.163 

40 

1.00 

3  . 

00 

0  . 

0 

N 

.056 

.053 

.234 

.493 

.301 

.246 

40 

1.00 

0  . 

33 

0  . 

5 

N 

.184 

.  179 

.069 

.  Oil 

.020 

.  028 

40 

1.00 

0  . 

50 

0  . 

5 

N 

.276 

.273 

.149 

.043 

.065 

.084 

40 

1.00 

1. 

00 

0  . 

5 

N 

.508 

.507 

.497 

.415 

.451 

.486 

40 

1.00 

2  . 

00 

0  . 

5 

N 

.280 

.276 

.493 

.659 

.544 

.507 

40 

1.00 

3  . 

00 

0  . 

5 

N 

.188 

.181 

.486 

.730 

.  545 

.471 

40 

1.00 

0  . 

33 

0  . 

7 

N 

.237 

.229 

.106 

.018 

.030 

.043 

40 

1.00 

0  . 

50 

0  . 

7 

N 

.403 

.395 

.240 

.073 

.109 

.  142 

40 

1.00 

1 . 

00 

0  . 

7 

N 

.692 

.692 

.676 

.582 

.626 

.  656 

40 

1.00 

2  . 

00 

0. 

7 

N 

.383 

.377 

.613 

.  746 

.658 

.  624 

40 

1.00 

3  . 

00 

0  . 

7 

N 

.240 

.232 

.585 

.793 

.622 

.560 

40 

1.00 

0. 

33 

0. 

9 

N 

.384 

.372 

.191 

.036 

.058 

.078 

40 

1.00 

0  . 

50 

0  . 

9 

N 

.575 

.570 

.393 

.150 

.213 

.258 

40 

1.00 

1 . 

00 

0  . 

9 

N 

.899 

.899 

.892 

.804 

.805 

.869 

40 

1.00 

2  . 

00 

0  . 

9 

N 

.579 

.574 

.783 

.867 

.806 

.  787 

40 

1 .  00 

3  . 

00 

0. 

9 

N 

.372 

.361 

.709 

.865 

.  725 

.671 

40 

0  .67 

0  . 

33 

0  . 

0 

N 

.029 

.053 

.007 

.001 

.001 

.002 

40 

0  .  67 

0  . 

50 

0  . 

0 

N 

.033 

.  052 

.014 

.003 

.  004 

.006 
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Table  39  --continued 
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N    n3/n,  (Je/ff^ 


D 


TT      WT  BT 


CTl  CT2 


JT 


40  0.67  1.00  0.0  N  .051  .051  .047  .054  .056  .061 

40  0.67  2.00  0.0  N  .070  .045  .145  .310  .217  .193 

40  0.67  3.00  0.0  N  .083  .046  .236  .494  .339  .284 

40  0.67  0.33  0.5  N  .130  .191  .056  .009  .016  .022 

40  0.67  0.50   0.5  N  .233  .301  .121  .044  .060  .073 

40  0.67  1.00  0.5  N  .492  .490  .469  .420  .454  .481 

40  0.67  2.00  0.5  N  .321  .251  .483  .654  .570  .537 

40  0.67  3.00  0.5  N  .241  .161  .492  .725  .587  .523 

40  0.67  0.33  0.7  N  .206  .291  .095  .018  .028  .040 

40  0.67  0.50  0.7  N  .342  .425  .216  .075  .107  .133 

40  0.67  1.00  0.7  N  .699  .694  .670  .603  .642  .672 

40  0.67  2.00  0.7  N  .436  .348  .601  .738  .675  .646 

40  0.67  3.00  0.7  N  .319  .231  .578  .788  .669  .610 

40  0.67  0.33   0.9  N  .301  .403  .153  .034  .051  .065 

40  0.67  0.50  0.9  N  .540  .628  .363  .154  .207  .246 

40  0.67  1.00  0.9  N  .905  .904  .892  .830  .860  .878 

40  0.67  2.00  0.9  N  .613  .520  .764  .862  .817  .796 

40  0.67  3.00  0.9  N  .440  .332  .694  .849  .751  .701 

40  1.50  0.33   0.0  N  .087  .047  .022  .003  .004  .007 

40  1.50  0.50  0.0  N  .074  .049  .026  .007  .011  .016 


Table  39  --continued 
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N    n^/n,  aja^ 


TT  WT 


BT  CTl 


CT2 


JT 


40  1.50  1.00  0.0  N  .053  .052  .054  .047 

40  1.50  2.00  0.0  N  .032  .049  .132  .267 

40  1.50  3.00  0.0  N  .029  .055  .218  .452 

40  1.50  0.33  0.5  N  .249  .166  .092  .015 

40  1.50  0.50  0.5  N  .315  .243  .165  .044 

40  1.50  1.00  0.5  N  .507  .503  .501  .405 

40  1.50  2.00  0.5  N  .228  .299  .500  .631 

40  1.50  3.00  0.5  N  .138  .203  .503  .716 

40  1.50  0.33   0.7  N  .311  .224  .132 

40  1.50  0.50  0.7  N  .438  .349  .250 

40  1.50  1.00  0.7  N  .693  .688  .685 

40  1.50  2.00  0.7  N  .332  .410  .631  .742 

40  1.50  3.00  0.7  N  .189  .256  .594  .780 

40  1.50  0.33   0.9  N  .421  .317  .209 

40  1.50  0.50   0.9  N  .625  .536  .423 

40  1.50  1.00  0.9  N  .893  .888  .881 

40  1.50  2.00  0.9  N  .543  .629  .804  .868 

40  1.50  3.00  0.9  N  .302  .411  .732  .863 

80  1.00  0.33   0.0  N  .053  .052  .014  .000 

80  1.00  0.50  0.0  N  .047  .047  .020  .002 


018 
083 
567 


040 
156 
769 


047 
145 
221 
027 
076 
446 
,497 
481 
041 
,127 
,619 
620 
560 
068 
232 
824 
789 
695 
000 
003 


.  054 
.118 
.171 
.038 
.098 
.480 
.454 
.401 
.057 
.297 
.652 
.579 
.487 
.092 
.284 
.  854 
.759 
.  634 
.  001 
.003 


Table  39  --continued 


N    njn^  a^/a^       P      D        TT      WT        BT         CTl     CT2  JT 


80  1.00 

80  1.00 

80  1.00 

80  1.00 

80  1.00 

80  1.00 

80  1.00 

80  1.00 

80  1.00 

80  1.00 

80  1.00 

80  1.00 

80  1.00 

80  1.00 

80  1.00 

80  1.00 

80  1.00 

80  1.00 

80  0.67 

80  0.67 

80  0.67 


1.00 

2  .00 

3  .00 
0  .33 
0  .50 
1.00 

2  .00 

3  .00 
0  .33 
0.50 
1.00 

2  .00 

3  .  00 
0.33 
0.50 
1.00 

2  .00 

3  .  00 
0.33 
0.50 
1.00 


0.0  N 

0.0  N 

0.0  N 

0.5  N 

0.5  N 

0.5  N 

0.5  N 

0.5  N 

0.7  N 

0.7  N 

0.7  N 

0.7  N 

0.7  N 

0.9  N 

0.9  N 

0.9  N 

0.9  N 

0.9  N 

0.0  N 

0.0  N 

0.0  N 


.053 
.  043 
.048 
.176 
.276 
.507 
.271 
.  179 
.249 
.398 
.  693 
.402 
.249 
.370 
.595 
.905 
.586 
.379 
.026 
.  034 
.048 


053 
043 
047 
173 
274 
507 
269 
176 
245 
,395 
,  693 
,399 
,246 
,366 
,593 
,905 
583 
,375 
050 
052 
048 


051 
142 
228 
066 
157 
499 
,487 
,496 
108 
,247 
,  685 
,631 
,588 
.183 
.414 
.900 
.796 
.  719 
.009 
014 
047 


.050 
.494 
.749 
.001 
.012 
.423 
.  824 
.910 
.004 
.026 
.585 
.888 
.  943 
.006 
.067 
.  817 
.953 
.968 
.000 
.001 
.051 


051 
353 
527 
002 
023 
454 
.731 
,779 
,006 
,  046 
,629 
,  824 
,  836 
,  009 
.103 
.  854 
.916 
.  902 
.000 
002 
048 


.053 
.276 
.417 
.004 
.034 
.475 
.665 
.687 
.010 
.  062 
.650 
.771 
.756 
.016 
.  131 
.  870 
.882 
.844 
.000 
.002 
.052 


Table  39  --continued 


N    n^/n^  a^/a^       P       D        TT      WT        BT         CTl     CT2  JT 


80  0.67 

80  0.67 

80  0.67 

80  0.67 

80  0.67 

80  0.67 

80  0.67 

80  0.67 

80  0.67 

80  0.67 

80  0.67 

80  0.67 

80  0.67 

80  0.67 

80  0.67 

80  0.67 

80  0.67 

80  1.50 

80  1.50 

80  1.50 

80  1.50 


2  .00 

3  .00 
0  .33 
0  .50 
1.00 
2.00 
3  .00 
0  .33 
0.50 
1.00 

2  .  00 

3  .00 

0.  33 
0  .50 

1 .  00 

2  .00 

3  .  00 
0.33 
0  .50 
1.00 
2  .00 


0.0  N 

0.0  N 

0.5  N 

0.5  N 

0.5  N 

0.5  N 

0.5  N 

0.7  N 

0.7  N 

0.7  N 

0.7  N 

0.7  N 

0.9  N 

0.9  N 

0.9  N 

0.9  N 

0.9  N 

0.0  N 

0.0  N 

0.0  N 

0.0  N 


.  073 
.083 
.145 
.223 
.492 
.324 
.233 
.  186 
.349 
.697 
.440 
.292 
.314 
.533 
.903 
.609 
.415 
.  082 
.073 
.050 
.030 


050 
050 
,211 
284 
,488 
,252 
,158 
,267 
.430 
.695 
.360 
.211 
.419 
.616 
.900 
.534 
.317 
.053 
049 
051 
050 


.152 
.244 
.  060 
.130 
.487 
.496 
.497 
.080 
.220 
.686 
.620 
.570 
.156 
.365 
.896 
.  767 
.691 
.  023 
.024 
052 
135 


.505 
.  742 
.001 
.013 
.425 
.811 
.889 
.001 
.024 
,607 
.876 
.922 
,006 
,  059 
,829 
,939 
,950 
,000 
,001 
.046 
.476 


.397 
.577 
.003 
.019 
.455 
.  744 
.  791 
.004 
.037 
.640 
.  827 
.  843 
.009 
.079 
.859 
.914 
.  892 
.000 
.  003 
.049 
.292 


.328 
.482 
.004 
.027 
.476 
.  687 
.714 
.006 
.050 
.662 
.784 
.  773 
.  014 
.106 
.  875 
.900 
.  843 
.  001 
.004 
.  050 
.223 
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Table  39  --continued 


TT      WT  BT 


CTl  CT2 


JT 


80  1.50  3.00  0.0  N  .032  .051  .207  .745  .461  .333 

80  1.50  0.33  0.5  N  .241  .166  .093  .004  .007  .009 

80  1.50  0.50  0.5  N  .320  .251  .167  .016  .028  .042 

80  1.50  1.00  0.5  N  .495  .494  .490  .391  .424  .448 

80  1.50  2.00  0.5  N  .237  .303  .504  .820  .690  .616 

80  1.50  3.00  0.5  N  .129  .194  .497  .911  .728  .617 

80  1.50  0.33  0.7  N  .310  .226  .133  .003  .008  .013 

80  1.50  0.50  0.7  N  .430  .350  .247  .027  .049  .069 

80  1.50  1.00  0.7  N  .690  .689  .685  .570  .608  .635 

80  1.50  2.00  0.7  N  .340  .420  .640  .890  .793  .729 

80  1.50  3.00  0.7  N  .195  .281  .591  .942  .794  .696 

80  1.50  0.33   0.9  N  .411  .314  .200  .008  .014  .026 

80  1.50  0.50  0.9  N  .610  .538  .416  .064  .107  .143 

80  1.50  1.00  0.9  N  .897  .896  .896  .794  .835  .854 

80  1.50  2.00  0.9  N  .539  .622  .798  .949  .898  .865 

80  1.50  3.00  0.9  N  .299  .413  .726  .969  .885  .809 

120  1.00  0.33   0.0  N  .054  .054  .016  .000  .000  .000 

120  1.00  0.50  0.0  N  .057  .056  .021  .000  .000  .001 

120  1.00  1.00  0.0  N  .050  .050  .051  .051  .051  .053 

120  1.00  2.00  0.0  N  .048  .047  .146  .660  .496  .405 

120  1.00  3.00  0.0  N  .053  .052  .222  .899  .710  .576 
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Table  39  --continued 


N  n^/n. 

C 

P 

D 

TT 

WT 

BT 

CTl 

CT2 

JT 

120 

1 

.00 

0  . 

33 

0  . 

5 

N 

.178 

.175 

.066 

.000 

.000 

.001 

120 

1 

.00 

0  . 

50 

0  . 

5 

N 

.282 

.281 

.158 

.  004 

.007 

.012 

120 

1 

.00 

1 . 

00 

0. 

5 

N 

.496 

.495 

.493 

.411 

.436 

.459 

120 

1 

.00 

2  . 

00 

0  . 

5 

N 

.272 

.271 

.499 

.910 

.  841 

.  782 

120 

1 

.00 

3  . 

00 

0  . 

5 

N 

.  185 

.  182 

.500 

.971 

.894 

.816 

120 

1 

.00 

0. 

33 

0  . 

7 

N 

.253 

.252 

.115 

.000 

.001 

.002 

120 

1 

.00 

0  . 

50 

0  . 

7 

N 

.384 

.383 

.238 

.010 

.020 

.029 

120 

1 

.00 

1 . 

00 

0  . 

7 

N 

.708 

.708 

.703 

.604 

.643 

.660 

120 

1 

.00 

2  . 

00 

0  . 

7 

N 

.403 

.401 

.636 

.950 

.900 

.900 

120 

1 

.  00 

3  . 

00 

0. 

7 

N 

.243 

.240 

.599 

.981 

.  930 

.  871 

120 

1 

.00 

0  . 

33 

0. 

9 

N 

.367 

.363 

.  185 

.001 

.002 

.005 

120 

1 

.00 

0. 

50 

0  . 

9 

N 

.587 

.585 

.407 

.027 

.046 

.064 

120 

1 

.00 

1 . 

00 

0  . 

9 

N 

.892 

.892 

.890 

.813 

.  843 

.856 

120 

1 

.00 

2  . 

00 

0  . 

9 

N 

.583 

.582 

.792 

.976 

.958 

.935 

120 

1 

.00 

3  . 

00 

0. 

9 

N 

.367 

.365 

.  724 

.990 

.961 

.928 

120 

0 

.67 

0  . 

33 

0  . 

0 

N 

.025 

.044 

.009 

.000 

.000 

.000 

120 

0 

.67 

0  . 

50 

0  . 

0 

N 

.033 

.050 

.014 

.000 

.  001 

.001 

120 

0 

.  67 

1 . 

00 

0. 

0 

N 

.  048 

.048 

.047 

.  054 

.053 

.  055 

120 

0 

.67 

2  . 

00 

0  . 

0 

N 

.  071 

.048 

.160 

.650 

.  537 

.450 

120 

0 

.67 

3  . 

00 

0  . 

0 

N 

.086 

.  053 

.249 

.  872 

.  746 

.  642 

120 

0 

.67 

0. 

33 

0. 

5 

N 

.125 

.192 

.051 

.000 

.000 

.000 

Table  3  9  --continued 


N    n^/n^  ffe/a^       P      D        TT      WT        BT       CTl       CT2  JT 


120  0.67 
120  0.67 
120  0.67 
120  0.67 
120  0.67 
120  0.67 
120  0.67 
120  0.67 
120  0.67 
120  0.67 
120  0.67 
120  0.67 
120  0.67 
120  0.67 
120  1.50 
120  1.50 
120  1.50 
120  1.50 
120  1.50 
120  1.50 
120  1.50 


0  .50 
1 .  00 

2  .00 

3  .00 
0  .33 
0  .50 
1.00 

2  .00 

3  .00 
0  .33 
0.50 
1.00 
2.00 
3  .00 
0  .33 
0  .50 
1.00 

2  .  00 

3  .00 
0  .33 
0.50 


0.5  N 

0.5  N 

0.5  N 

0.5  N 

0.7  N 

0.7  N 

0.7  N 

0.7  N 

0.7  N 

0.9  N 

0.9  N 

0.9  N 

0.9  N 

0.9  N 

0.0  N 

0.0  N 

0.0  N 

0.0  N 

0.0  N 

0.5  N 

0.5  N 


.229 
.501 
.320 
.232 
.188 
.352 
.709 
.442 
.320 
.305 
.547 
.901 
.609 
.428 
.079 
.075 
.046 
.  033 
.  029 
.245 
.316 


292 
500 
255 
163 
272 
,432 
,  704 
,362 
,231 
,414 
.631 
,901 
,533 
,332 
,048 
,050 
,046 
,  052 
,049 
167 
249 


136 
491 
504 
,504 
,087 
,223 
,  702 
,  617 
,  587 
,163 
.396 
.900 
.  775 
.  693 
.018 
.026 
.048 
.134 
.206 
,  090 
,167 


,004 
,427 
,900 
,960 
,001 
.008 
.  622 
.  934 
.970 
.000 
.030 
.822 
.973 
.982 
.000 
.000 
.045 
.642 
.894 
.000 
.004 


.007 
.453 
.848 
.906 
.001 
.  014 
.652 
.903 
.926 
.002 
.  054 
.849 
.958 
.956 
.000 
.  001 
.  050 
.435 
.656 
.001 
.009 


.  010 
.467 
.795 
.  844 
.002 
.  021 
.669 
.863 
.  874 
.004 
.062 
.849 
.936 
.925 
.000 
.002 
.049 
.333 
.496 
.  002 
.016 
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Table  39  --continued 


N    n^/n^  a^/a^       P  D  TT  WT  BT  CTl  CT2  JT 

120  1.50  1.00  0.5  N  .506  .503  .500  .400  .432  .453 

120  1.50  2.00  0.5  N  .231  .304  .508  .907  .809  .733 

120  1.50  3.00  0.5  N  .127  .195  .504  .973  .864  .768 

120  1.50  0.33   0.7  N  .317  .231  .130  .001  .002  .003 

120  1.50  0.50  0.7  N  .434  .363  .254  .014  .023  .036 

120  1.50  1.00  0.7  N  .712  .711  .707  .593  .638  .655 

120  1.50  2.00  0.7  N  .356  .436  .650  .953  .896  .838 

120  1.50  3.00  0.7  N  .189  .282  .616  .986  .915  .835 

120  1.50  0.33   0.9  N  .433  .337  .213  .003  .005  .011 

120  1.50  0.50  0.9  N  .624  .539  .419  .037  .059  .084 

120  1.50  1.00  0.9  N  .898  .900  .900  .800  .842  .859 

120  1.50  2.00  0.9  N  .556  .637  .814  .982  .958  .931 

120  1.50  3.00  0.9  N  .306  .416  .742  .994  .954  .909 

40  1.00  0.33  0.0  L  .090  .088  .049  .014  .030  .043 

40  1.00  0.50  0.0  L  .072  .071  .051  .020  .037  .051 

40   1.00  1.00   0.0  L  .051  .049  .097  .051  .049  .057 

40  1.00  2.00  0.0  L  .033  .032  .169  .130  .063  .046 

40  1.00  3.00  0.0  L  .028  .025  .236  .205  .082  .057 

40   1.00  0.33   0.5  L  .255  .250  .145  .052  .092  .129 

40  1.00  0.50  0.5  L  .336  .332  .241  .115  .189  .233 

40  1.00  1.00  0.5  L  .523  .522  .515  .356  .442  .494 


Table  39  --continued 
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N  n^/n^  oja^ 


D 


TT  WT 


BT       CTl       CT2  JT 


40  1.00 
40  1.00 
40  1.00 
40  1.00 
40  1.00 
40  1.00 
40  1.00 
40  1.00 
40  1.00 
40  1.00 
40  1.00 
40  1.00 
40  0.67 
40  0.67 
40  0.67 
40  0.67 
40  0.67 
40  0.67 
40  0.67 
40  0.67 
40  0.67 


2  .00  0.5 
3 .00  0.5 


L 
L 


0.33  0.7  L 

0.50  0.7  L 

1.00  0.7  L 

2.00  0.7  L 

3.00  0.7  L 

0.33  0.9  L 

0.50  0.9  L 

1.00  0.9  L 

2.00  0.9  L 

3.00  0.9  L 

0.33  0.0  L 

0.50  0.0  L 

1.00  0.0  L 

2.00  0.0  L 

3.00  0.0  L 

0.33   0.5  L 

0.50  0.5  L 

1.00  0.5  L 

2.00  0.5  L 


.245 
.  147 
.321 
.453 
.705 
.380 
.204 
.441 
.605 
.891 
.  614 
.348 
.059 
.058 
.056 
.048 
.059 
.207 
.282 
.  520 
.295 


238 
138 
315 
449 
704 
372 

,194 
432 
597 

,890 
606 

,336 

,  080 
068 

,040 
026 
024 
261 
332 
516 
200 


.505 
.494 
.202 
.336 
.671 
.617 
.581 
.284 
.465 
.  846 
.  777 
.  701 
.  031 
.  042 
.087 
.  162 
.238 
.  122 
.  194 
.505 
.486 


411 
430 
082 

,  170 
,508 
,514 
.504 
,121 
.258 
.  707 
.688 
.633 
.  010 
.018 
.053 
.  142 
,238 
.052 
111 
,372 
,415 


.316 
.255 
.134 
.272 
.  622 
.439 
.320 
.203 
.387 
.  807 
.  642 
.467 
.  021 
.034 
.  055 
.  079 
.125 
.091 
.160 
.456 
.341 


.284 
.202 
.182 
.331 
.676 
.411 
.265 
.254 
.452 
.851 
.634 
.407 
.031 
.046 
.060 
.  063 
.093 
.  118 
.201 
.508 
.314 
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Table  39  --continued 


N     njn^  aja^       P       D         TT      WT        BT         CTl       CT2  JT 


40     0.67     3.00   0.5  L  .196  .111  .477  .444  .297  .244 

40     0.67     0.33  0.7  L  .260  .325  .166  .073  .125  .156 

40     0.67     0.50  0.7  L  .396  .456  .288  .168  .246  .294 

40     0.67     1.00  0.7  L  .707  .720  .664  .546  .633  .683 

40     0.67     2.00  0.7  L  .428  .327  .601  .532  .466  .444 

40     0.67     3.00   0.7  L  .268  .167  .570  .521  .372  .317 

40     0.67     0.33  0.9  L  .391  .466  .261  .122  .190  .236 

40     0.67     0.50  0.9  L  .573  .638  .438  .288  .392  .455 

40     0.67     1.00  0.9  L  .893  .908  .848  .759  .840  .875 

40     0.67     2.00  0.9  L  .639  .556  .753  .691  .662  .656 

40     0.67     3.00  0.9  L  .412  .275  .682  .632  .494  .444 

40     1.50     0.33  0.0  L  .117  .089  .061  .017  .035  .054 

40     1.50     0.50  0.0  L  .106  .090  .069  .024  .047  .068 

40     1.50     1.00  0.0  L  .045  .060  .096  .047  .046  .051 

40     1.50     2.00  0.0  L  .017  .038  .173  .116  .044  .032 

40     1.50     3.00  0.0  L  .015  .031  .229  .162  .046  .031 

40     1.50     0.33   0.5  L  .299  .234  .176  .054  .105  .143 

40     1.50     0.50  0.5  L  .377  .325  .268  .108  .188  .249 

40     1.50     1.00   0.5  L  .532  .534  .535  .341  .438  .505 

40     1.50     2.00  0.5  L  .199  .293  .519  .385  .280  .250 

40     1.50     3.00  0.5  L  .091  .159  .505  .393  .187  .142 
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Table  3  9  --continued 


D 


TT  WT 


BT       CTl  CT2 


JT 


40  1.50 

40  1.50 

40  1.50 

40  1.50 

40  1.50 

40  1.50 

40  1.50 

40  1.50 

40  1.50 

40  1.50 

80  1.00 

80  1.00 

80  1.00 

80  1.00 

80  1.00 

80  1.00 

80  1.00 

80  1.00 

80  1.00 

80  1.00 

80  1.00 


0  .33 
0  .50 
1.00 

2  .00 

3  .  00 
0  .33 
0  .50 
1.00 

2  .00 

3  .00 
0  .  33 
0  .50 
1.00 
2.00 
3  .  00 
0.33 
0  .50 
1.00 

2  .00 

3  .  00 
0  .33 


0.7 
0  .  7 
0.7 
0.7 
0.7 
0.9 
0.9 
0.9 
0.9 


0.0 
0.0 


L 
L 
L 
L 
L 
L 
L 
L 
L 


0.9  L 

0.0  L 

0.0  L 

0.0  L 


L 
L 


0.5  L 
0.5  L 


0.5 
0.5 
0.5 
0.7 


L 
L 
L 
L 


.376 
.488 
.717 
.342 
.  141 
.493 
.  644 
.900 
.580 
.274 
.081 
.065 
.046 
.037 
.  033 
.221 
.320 
.514 
.251 
.  146 
.297 


.306 
.422 
.706 
.439 
.230 
.411 
.575 
.880 
.660 
.408 
.080 
.065 
.046 
.037 
.031 
.219 
.319 
.  514 
,247 
,143 
292 


.289 
.352 
.689 
.640 
.587 
.319 
.481 
.853 
.  791 
.728 
.037 
.040 
.076 
.166 
.236 
.120 
.222 
.512 
.494 
.473 
.172 


.080 
.160 
.481 
.487 
.466 
.  110 
.231 
.672 
.666 
.608 
.001 
.001 
.049 
.207 
.332 
,019 
.069 
,352 
,506 
576 
033 


.  147 
.265 
.611 
.406 
.257 
.203 
.369 
.802 
.  621 
.409 
.  015 
.  022 
.  049 
.  093 
.131 
,  049 
,137 
431 
365 
328 
075 


.191 
.331 
.675 
.381 
.208 
.260 
.446 
.851 
.  613 
.343 
.024 
.034 
.050 
.059 
.  076 
.  076 
.189 
.486 
.291 
.232 
.109 
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Table  39  --continued 


N    njn,  a  J  a,     P       D         TT      WT        BT       CTl  CT2 


JT 


80  0.67  3.00  0.0  L 

80  0.67  0.33  0.5  L 

80  0.67  0.50  0.5  L 

80  0.67  1.00  0.5  L 

80  0.67  2.00  0.5  L 

80  0.67  3.00  0.5  L 

80  0.67  0.33  0.7  L 

80  0.67  0.50  0.7  L 

80  0.67  1.00  0.7  L 

80  0.67  2.00  0.7  L 

80  0.67  3.00  0.7  L 

80  0.67  0.33  0.9  L 

80  0.67  0.50  0.9  L 

80  0.67  1.00  0.9  L 

80  0.67  2.00  0.9  L 

80  0.67  3.00  0.9  L 

80  1.50  0.33  0.0  L 

80  1.50  0.50  0.0  L 

80  1.50  1.00  0.0  L 

80  1.50  2 .00  0 .0  L 

80  1.50  3.00  0.0  L 


.061 
.  182 
.273 
.518 
.301 
.208 
.244 
.364 
.699 
.422 
.282 
.341 
.562 
.  897 
.624 
.424 
.111 
.  090 
.046 
.016 
.013 


507  .383 
493  .514 


027  .243  .367 

251  .103  .024 

340  .193  .072 
503 
218 

121  .486  .588 

321  .146  .036 

456  .279  .103 

712  .674  .537 

341  .601  .622 
179  .568  .660 
430  .221  .064 
640  .431  .198 
910  .866  .755 
541  .758  .761 
295  .681  .757 

009 


081  .053 
072  .052 


055 
036 


084 
153 


030  .222 


,  010 
,  047 
173 
293 


187 
,051 
,133 
,453 
.412 
.388 
.  073 
.  182 
.625 
,520 
.479 
.115 
.301 
.837 
.697 
.596 
,021 
,026 
046 
061 
082 


.124 
.  075 
.173 
.500 
.345 
.289 
.  104 
.241 
.679 
.455 
.370 
.159 
.371 
.  872 
.651 
.496 
.034 
.  041 
.  048 
.036 
.039 
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Table  3  9  --continued 


N    n^/n^  ae/cr^         P      D       TT        WT        BT       CTl       CT2  JT 


80  1.50 

80  1.50 

80  1.50 

80  1.50 

80  1.50 

80  1.50 

80  1.50 

80  1.50 

80  1.50 

80  1.50 

80  1.50 

80  1.50 

80  1.50 

80  1.50 

80  1.50 

120  1.00 

120  1.00 

120  1.00 

120  1.00 

120  1.00 

120  1.00 


0  .33 
0  .50 
1.00 

2  .00 

3  .00 
0  .33 
0  .50 
1.00 

2  .  00 

3  .00 
0  .33 
0  .50 
1.00 
2.00 
3  .00 
0  .33 

0.  50 

1 .  00 

2  .  00 

3  .00 
0.33 


0.5 
0.5 
0.5 
0  .  5 
0.5 


0.7 
0.7 
0.7 
0.9 
0.9 
0.9 
0.9 
0.9 
0.0 


L 
L 
L 
L 
L 


0.7  L 
0.7  L 


L 
L 
L 
L 
L 
L 
L 
L 
L 


0.0  L 
0.0  L 


0.0 
0.0 
0.5 


L 
L 
L 


.277 
.370 
.516 
.203 
.091 
.362 
.464 
.726 
.328 
.167 
.453 
.628 
.897 
.560 
.280 
.073 
.062 
.045 
.032 
.032 
.226 


,224 
.314 
,512 
,283 
.161 
,285 
.405 
.  719 
.415 
.268 
.380 
.554 
.885 
.641 
.408 
.  072 
.061 
,  045 
032 
032 
224 


.156 
.237 
.513 
.510 
.481 
.205 
.  320 
.705 
.629 
.605 
.274 
.461 
.860 
.785 
.734 
.032 
.039 
.  068 
.161 
.225 
.114 


.027 
.067 
.336 
.495 
.542 
.039 
.109 
.513 
.607 
.639 
.056 
.173 
,  691 
.754 
,  764 
,002 
006 
045 
259 
449 
Oil 


.066 
.137 
.429 
.325 
,254 
,  090 
.200 
.629 
.452 
.357 
.129 
.307 
,810 
,652 
,503 
009 
018 
045 
113 
182 
033 


.  104 
.196 
.485 
.254 
.164 
.135 
.266 
.686 
.381 
.257 
.  182 
.402 
.  860 
.600 
.383 
.  017 
.028 
.047 
.  067 
.101 
.055 
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Table  3  9  --continued 


N    n^/n^  a^/a^       P      D       TT        WT        BT       CTl       CT2  JT 


120  1.00 
120  1.00 
120  1.00 
120  1.00 
120  1.00 
120  1.00 
120  1.00 
120  1.00 
120  1.00 
120  1.00 
120  1.00 
120  1.00 
120  1.00 
120  1.00 
120  0.67 
120  0.67 
120  0.67 
120  0.67 
120  0.67 
120  0.67 
120  0.67 


0  .50 
1 .  00 

2  .00 

3  .00 
0  .33 
0.50 
1.00 

2  .  00 

3  .00 
0.33 
0.50 
1.00 

2  .00 

3  .00 
0  .33 
0.50 
1.00 

2  .  00 

3  .00 
0.33 
0.50 


0.5 
0.5 
0.5 
0.5 
0.7 
0.7 
0.7 
0.7 
0.7 
0.9 


0.9 
0.9 
0.0 
0.0 
0.0 
0.0 


L 
L 
L 
L 
L 
L 
L 
L 
L 
L 


0.9  L 
0.9  L 


L 
L 
L 
L 
L 
L 


0.0  L 
0.5  L 
0.5  L 


.311 
.500 
.261 
.152 
.288 
.416 
.717 
.385 
.224 
.417 
.584 
.  900 
.602 
.353 
.044 
.046 
.052 
.  054 
.065 
.170 
.260 


.310 
.500 
,259 
.150 
,286 
.415 
,716 
.382 
.220 
.414 
.583 
.  900 
.600 
.347 
.067 
.061 
.043 
.030 
.029 
,231 
,316 


199 
500 
503 
,492 
,160 
,289 
,700 
,  614 
,584 
,259 
,440 
,  871 
,782 
,713 
,  021 
030 
069 
167 
242 
089 
180 


.  044 

.  354 
.592 
.700 
.  017 
.073 
.513 
.700 
.764 
.037 
.  128 
.734 
.816 
.846 
.002 
.006 
.052 
.280 
.468 
.011 
.  043 


100 

,420 
,420 
408 
,053 
,158 
,620 
,543 
.504 
.100 
,254 
,827 
,  722 
,630 
,006 
,012 
051 
148 
240 
028 
097 


.  154 
.465 
.335 
.274 
.085 
.220 
.  678 
.449 
.359 
.136 
.342 
.869 
.  651 
.493 
.012 
.020 
.053 
.091 
.  145 
.048 
.132 


110 


Table  39  --continued 


N 

P 

D 

TT 

WT 

BT 

CTl 

CT2 

JT 

120 

0 

.67 

1 

.00 

0. 

5 

L 

.517 

.517 

.507 

.382 

.451 

.492 

120 

0 

.67 

2 

.  00 

0  . 

5 

L 

.298 

.220 

.483 

.595 

.453 

.365 

120 

0 

.67 

3 

.00 

0  . 

5 

L 

.211 

.133 

.481 

.684 

.477 

.344 

120 

0 

.67 

0 

.33 

0. 

7 

L 

.233 

.307 

.135 

.018 

.045 

.073 

120 

0 

.67 

0 

.50 

0  . 

7 

L 

.380 

.454 

.265 

.082 

.156 

.217 

120 

0 

.67 

1 

.  00 

0  . 

7 

L 

.719 

.728 

.692 

.548 

.637 

.683 

120 

0 

.67 

2 

.00 

0. 

7 

L 

.425 

.340 

.606 

.688 

.571 

.483 

120 

0 

.67 

3 

.00 

0 

7 

L 

.277 

.184 

.562 

.751 

.553 

.421 

120 

0 

.67 

0 

.33 

0 

9 

L 

.357 

.446 

.223 

.036 

.082 

.126 

120 

0 

.67 

0 

.50 

0. 

9 

L 

.563 

.634 

.435 

.  146 

.267 

.349 

120 

0 

.67 

1 

.00 

0. 

9 

L 

.900 

.912 

.  877 

.754 

.  841 

.875 

120 

0 

.67 

2 

.00 

0  . 

9 

L 

.638 

.560 

.775 

.820 

.  747 

.684 

120 

0 

.67 

3 

.00 

0  . 

9 

L 

.402 

.289 

.680 

.833 

.659 

.532 

120 

1 

.50 

0 

.33 

0  . 

0 

L 

.106 

.078 

.  047 

.003 

.011 

.023 

120 

1 

.50 

0 

.50 

0. 

0 

L 

.094 

.  074 

.  051 

.006 

.019 

.  034 

120 

1 

.50 

1 

.00 

0  . 

0 

L 

.050 

.058 

.078 

.  047 

.  048 

.050 

120 

1 

.50 

2 

.00 

0. 

0 

L 

.  018 

.038 

.  155 

.232 

.086 

.  044 

120 

1 

.50 

3 

.  00 

0  . 

0 

L 

.016 

.037 

.223 

.414 

.120 

.  049 

120 

1 

.50 

0 

.33 

0  . 

5 

L 

.275 

.217 

.142 

.  014 

.039 

.  071 

120 

1 

.50 

0 

.50 

0  . 

5 

L 

.349 

.294 

.220 

.  047 

.  109 

.159 

120 

1 

.50 

1 

.00 

0. 

5 

L 

.510 

.510 

.508 

.353 

.432 

.478 

i 

■  .1 

1 

I 

i 


Table  39  --continued 


N    n^/n^  ffe/o'c         P       D       TT        WT        BT       CTl       CT2  JT 


120 
120 
120 
120 
120 
120 
120 
120 
120 
120 
120 
120 


1.50 
1.50 
1.50 
1.50 
1.50 
1.50 
1.50 
1.50 
1.50 
1.50 
1.50 
1.50 


2.00  0.5 

3.00  0.5 

0.33  0.7 

0.50  0.7 

1.00  0.7 

2.00  0.7 

3.00  0.7 

0.33  0.9 

0.50  0.9 

1.00  0.9 

2.00  0.9 

3.00  0.9 


L 
L 
L 
L 
L 
L 
L 
L 
L 
L 
L 
L 


.204 
.  104 
.355 
.481 
.714 
.330 
.168 
.449 
.631 
.898 
.558 
.276 


,277 
,182 
,278 
,421 

707 
,424 

263 
,370 
,567 
,884 
,644 
,393 


.495 
.504 
.190 
.324 
.692 
.628 
.593 
.272 
.461 
.867 
.785 
.727 


565 
683 
017 
073 
493 
674 
741 
040 
137 
700 
811 
839 


,361 
,351 
,053 
,165 
,609 
,494 
,426 
.094 
,271 
,  812 
.699 
,563 


.266 
.216 
.091 
.244 
.673 
.403 
.291 
.  147 
.366 
.  861 
.617 
.407 


APPENDIX  B 

VARIANCE  COMPONENTS  FOR  ESTIMATED  TYPE  I  ERROR  RATES  AND 
POWER  WHEN  Q!=0.01  AND  Q!=0.10 


Table  40 

Percent  of  Total  Variance  for 


Estimated  Type  I  Error 

Rates  Effects  Accounting  al%  of 

the  Variance  (q;=0.01) 


Effect  Percentage 


1 .  82 

MxN 

2  .83 

MxNxD 

4.47 

Mxng/n^ 

5.60 

D 

6.11 

M 

25.18 

MxD 

49  .  97 
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Table  41 


Percent  of  Total  Variance  for 
Estimated  Type  I  Error 
Rates  Effects  Accounting  £l%  of 
the  Variance  (q!=0.10) 


Effect  Percentage 


n_/n_ 

1.05 

MxN 

2.56 

D 

2  .83 

MxNxD 

2  .85 

NxD 

4.01 

Nxn^/n^ 

4  .23 

Nxn^/n^xD 

4  .92 

N 

5  .50 

Dxn^/n^ 

7.17 

M 

19.55 

MxD 

41 .  87 

Table  42 

Percent  of  Total  Variance  for  Estimated 
Power  (Variance  Differences  Only)  Effects 
Accounting  al%  of  the  Variance  (a;=0.01) 


Effect  Percentage 


1 . 00 

1 . 35 

MxNxD 

1.41 

NxD 

1 . 44 

1 . 59 

N 

2.34 

NxcTe/a^ 

3.27 

MxN 

3  .55 

D 

3  .97 

MxNxag/a^ 

4.15 

MxD 

6.82 

CTe/ff^xD 

6.85 

Mxae/a^xD 

7  .09 

M 

12  . 18 

Mxa^/(T^ 

20  .  08 

20  .27 
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Table  43 

Percent  of  Total  Variance  for  Estimated 
Power  (Variance  Differences  Only)  Effects 
Accounting  ^1%  of  the  Variance  (q!=0.10) 

Effect  Percentage 


N 

1 .  06 

MxN 

1.34 

MxNxae/ 

1.75 

1.94 

D 

3  .57 

MxD 

4  .42 

MxcTe/  a^xD 

5.12 

aJo^xD 

7.66 

M 

10  .05 

27  .  98 

32  .  77 

Table  44 


Percent  of  Total  Variance  for 
Estimated  Power  (Mean  and 
Variance  Differences)  Effects 
Accounting  al%  of  the  Variance 
(a=0.01) 


Effect  Percentage 


D 

1 , 

.04 

1 , 

.34 

NX, /a. 

1 

.62 

MxD 

2 

.35 

Mxffe/a^xD 

2 

.45 

M 

2  , 

.61 

ff,/a^xD 

5  , 

.31 

ffe/cr^xP 

5  . 

.62 

P 

13  . 

.18 

Mxa^/a^ 

21 . 

.48 

37  , 

.88 
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Table  45 

Percent  of  Total  Variance  for 
Estimated  Power  (Mean  and 
Variance  Differences)  Effects 
Accounting  ^1%  of  the  Variance 
(q;=0.10) 


Effect  Percentage 


Mxa^/a^xD 


2  .45 


5  .31 


P 


10.80 


23  .15 


54  .85 
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